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In the decade of the sixties educators became increasingly 
aware of the population of children in the elementary schools 
who were variously labeled as emotionally disturbed, acting-out, 
hyperactive, socially maladjusted or exhibiting deviant behaviors. 
For the above group of labels, the most frequently used global 
description is currently M a child who exhibits behavior devia- 
tions/’ Kirk (1962) defines a behavior deviation as ‘'that 
behavior of a child which (1) has a detrimental effect on his 
development and adjustment and/or (2) interferes with the lives 
of other people^. 330> " Determining what is and is not "detri- 
mental" and does or does not "interfere" is the function of the 
setting in which the child finds himself. In the case of the 
school setting the teachers, peers and miscellaneous school 
staff as well as the physical setting itself, determine the 
boundaries for acceptable behavior. 

An early investigation by Ullmann (1952) found that eight 
per cent of the regular classroom children were rated as maladjusted 
by their teachers. The Special Education Department of the co- 
operating school district conducted a study (1961) to determine 
-he number of maladjusted children. This was accomplished by 
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having each regular classroom teacher list the maladjusted child- 
ren in her classroom, according to her own definition of malad- 
justment. An average of 7.3 percent: of all children in grades 
one through six were reported as maladjusted. The lowest pergenW 
(5.84) occurred in grade one and the highest in gr Je six (8.15). 

In previous studies (Walker, Mattson, and Buckley, 1969; 
Mattos, Walker, Matt6cm, and Buckley, 1969), the authors found 
that children identified as exhibiting deviant behaviors (N*=12) 
spent on the average only 36 percent:- of the available ctme in 
task related activities. Thus, it is not surprising that the 
authors found the group of twelve behaviorally deviant children 
(1967-68) to be, on the average, behind grade level 2.2 years 
in reading (-.1 to -5.1; Gray r s Oral) and behind grade level -.4 
years in math (-3.G to 2.2; Wide Range Achievement Test). Stennett 
(1966) looked at children In grades four through six and found 
that in general ,T EHC | emotionally handicapped children^) tend to 
get farther and farther behind their classmates in achievement 
as they move over the elementary school years. £ Pi448jf, 0 

Early attempts to treat the "acting-out" child in special 
classes within the school setting met with little demonstrable 
success. Kounin, Friesen, and Norton (1966), Rabinovich (1959), 
and Shannon (1963), suggest that the inability of the schools to 
deal effectively with these children stems primarily from the lack 
of established procedures and techniques that might be effectively 
employed within the context of the regular school setting. 
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The experimental analysis of behavior undertaken by Skinner 
in 1938 revealed many principles from which valuable behavior 
modification techniques have been derived. The success of these 
techniques in changing behavior has been widely demonstrated in 
laboratory settings. Extensions of these same principles to the 
behavior or deviant children in applied settings also met with 
considerable success (Patterson, 1965a, b; Straughan, 1964; 
Zimmerman and Zimmerman, 1962). Staats, Finley, Minke , Wolf and 
Brooks (1964) used a token reinforcement system to maintain read- 
ing behavior of three, four-year-old children. These studies 
reflect, for the most part, behavior modification with individuals 
or small groups in highly controlled settings. Because of the 
success achieved when using tokens with individuals in laboratory 
and applied settings, investigators began to apply the token 
economy to large groups of children (Girarduau & Spradlin, 1964; 
Bimbrauer 6 Lawler, 1964; Hewett, 1966). 

A token economy is one in which desirable responses are 
followed by administration of a stimulus (marks, chips, stars, 
etc.) to be traded in for certain special items or activities. 
Thus, the child learns the contingent relationship between be- 
having appropriately and the reinforcing consequences. The token 
reinforcers used in these systems may be tangible (Hewett, 1966) 
or symbolic (Valett, 1967). Thtiir value is derived from the 
various kinds of "back-up" reinforcers (candy, trinkets, free 
time, etc.) for which they are exchanged. Once the desired 
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behaviors come under reinforcer control, more contrived back-up 
rein forcers are gradually eliminated and replaced by reinforcing 
stimuli more readily available in the classroom environment. This 
process is facilitated by pairing the presentation of the tangible 
or token reinforcers with social reinforcers and gradually fading 
out the presentation of the contrived reinforcers (tokens and toys). 
Quay and associates (Quay, Werry, McQueen, & Sprague, 19*6; Quay, 
Sprague, Worry , McQueen, 1967) increased attending behavior in 
classroom for "conduct problem children" by flashing a snail der'c 
unit light for attending behavior followed by candy and/or social 
reinforcement at the end of the period. 

In 1966 the authors began to identify and treat children vi1*r 
behavior problems in an experimental class setting (Mattson and 
Walker, 1966), The rationale for the treatment model was based on 
the token economy. Since that time, variations of the token 
economy have been implemented in at least 100 separate programs in 
this country (Krasner & At t owe in O’Leary & Drabraan, 1970). O’Leary 
and Becker (1967) successfully used a token program to control the 
behavior of a large class (N a 17) of emotionally disturbed children. 
In addition, token reinforcement programs have been extended to 
junior high age children (Broden, Hall, Dunlap & Clark, 1970); 
and regular elementary school classrooms {O'Leary, Becker, Evans 
and Saudavgas, 1969). O’Leary, et. al. (1969) investigated seven 
children with disruptive behaviors in a regular second grade 
classroom. Systematic introductions of "Roles," "Educational 
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Structure," ’’Praising Appropriate Behavior," and "ignoring Disrup- 
tive Behavior" did not consistently reduce disruptive behavior. 
Only when the token system with back-up reinforcers was added to 
the previous variables did disruptive behavior decline for six of 
the seven subjects. 

This paper describes the development and evaluation of a 
treatment model which is designed to Provide efficient modifica- 
tion of one class of deviant behavior : hyperactive, disruptive, 

acting-out behavior in the classroom. The data were gathered 
during 1968-1970 in a special class setting, the Engineered 
Learning Project (ELP). The data presented here were generated 
by an inter-subject replication of the design, procedures, and 
results of the treatment model and by an evaluation of the com- 
ponents of this model. Special attention was given to the per- 
sistence of treatment effects across time and across settings. 

The goal of this research was the development of a workable 
treatment model, adapted to the school setting, which can be 
implemented by regular school personnel. 

Method 

Subjects 

Forty-four subjects were included in the treatment classroom 

from 1968-1970. The subjects (39 males; 5 females) were enrolled 

o 

in eight groups of six children each." The children ranged in 
age from 8.1 years to 12.6 years. In the regular classroom the 
children were in grades three through'six (grade 3t N * 12; grade 
A; N ** 12; grade 5t N * 10; grade 6: N - 10). 
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The children were selected from 24 elementary schools in 
the local school district. Selection criteria used average or 
above average intellectual ability, inadequate academic per- 
formance, and socially deviant behavior occurring within the 
regular classroom setting. All subjects possessed a number of 
behaviors which made them poor candidates for learning. Teacher 
defiance, dis tractibility , hyperactivity, and tantrum behavior 
were attributed to the group as a whole. Individual behaviors 
exhibited were physical and verbal abuse of peers, pre-delinquent 
behaviors (stealing, smoking, glue-sniffing), rejection of peer 
in terac tion*and excessive verbal outbursts (swearing, loud noises, 
smart talk). These behaviors were identified as most annoying to 
the regular classroom teacher; yet the subjects exhibited many 
additional behaviors illustrative of inadequate social and academic 
adjustment. All candidates for the experimental classroom were 
screened by the Walker Problem Behavior Identification Checklist 
(Walker, 1970), a behavior rating scale (Walker, 1969) and base- 
line observations of attending behavior taken within the regular 
classroom. All subjects scored average or above on standardized 
intelligence tests (WISC: Stanford-Binet) , but had educational 
deficits in reading of from two Tenths ti>'3.9 years (GateS-McKillip 
Reading Diagnostic Test) and froui 0 bne month to ‘3.5 years in math r.'kil 
(Stanford Diagnostic Arithmetic Test). 

All of the children received standard audif.ory, visual and 
general health tests either prior to, or during, enrollment in 
the classroom. No major deficita were displayed and minor deficits 
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were corrected by prosthetic devices and seating arrangements. 

Six of the 44 subjects hau been on various drugs prior to enroll- 
ment to reduce hyperactivity but requests were made for all six 
parents <o terminate drugs during treatment end follow-up* At 
follow-up conferences the parents reaffirmed that each child was 
still off medication. 



Setting 

The classroom facilities were adjoining and affiliated with 
a public elementary school in the Eugene School District. The 
primary area for academic activities contained six double desks 
(approximately 20” x 45" work surface), the teacher's desk, and 
shelves and tables for the display of higu interest materials for 
science and art projects, a carpentry room with a variety of tools a nd 
wood, and the necessary observation facilities. Adjoining rooms 
provided sink and table facilities. Space was alt'o available for 
individual testing, tutoring, and remedial instruction, A small 
isolation room (time-out), containing a chair and ds&k, adjoining 
the classroom (Figure 1). The children us^d the same playground 
and lunch facilities as the regularly enrolled students in the school. 

Insert Figure 1 About Here 



The children were in the special class daily for approximately 
three hours and forty minutes. Of that time, approximately two 
hour 8 and fifty minutes were devoted to academic assignments, forr.v- 
iive minutes to p. e. and recess and ten to point counting and 
trading for prizes at the end of the day. 
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The class ended at 1:45 and the children were, in most cases, 
bussed back to their regular classes for one hour of continued 
academic work. 

Each morning the teacher and teacher aide were both present 
in the classroom to answer questions, correct papers and listen to 
reading. Following lunch break, and for the last forty-five minutes 
of the day, the teacher operated the classroom by herself. 

A pparatus and Material s 

Display board . An electronic displayed board designed by 
the project staff (Walker, Mattson, and Buckley, 1969) was used 
for recording reinforcing events and providing subjects with dis- 
criminative stimuli for appropriate and inappropriate behaviors. 

■The device was also designed to provide a more systematic pre- 
sentation and removal of points than can be provided by teacher 
nark a on point sheets. 

The display board contained a unit for each subject with name, 
stimulus light, three-digit plus and three-digit minus counters. 

A similar unit set apart from the rest and containing a larger 
light was used for recording and regulating the group reinforcing 
climate. A control panel at the side of the room allowed immediate 
and visible reinforcement. Each subject was required to be in his 
seat ready to begin the assignment before his light came ^ . When 
the stimulus light was on, it signified that the child was behav- 
ing appropriately and that he had gained access to a schedule of 

o 

FRIT enforcement. When a child received a point, his light flashed, 




there was an audible click, and the cumulative counter recorded 
the event. If the child was behaving inappropriately, hio light 
was extinguished and a buzzer sounded which signalled the occurr- 
ence of deviant behavior. The subject had ten seconds in which to 
modify his behavior. If he did not modify his behavior within 
this time period, one point was subtracted for every sixty seconds 
that the deviant behavior persisted. No subject's points were 
ever taken below zero. Thus, if a subject failed to modify his 
behavior and lost all his points for that day he was placed in 
time-out. At any time that * l* became necessary for a child to be 
placed in the time-out room or to be suspended from the experi- 
mental classroom, his stimulus light remained off, as did the group 
light, until he returned to the classroom. 

At the end of the day, plus and minus points as well as total 
accumulated points for each child were announced to the entire 
class by the teacher. At the seme time she transferred the points 
to a cumulative point sheet. Thus each day the subjects began 
with zero points on the display board. In this way each child was 
able to easily identify his daily achievement. 

The display board proved to be very successful in operation 
for the three year period in a number of ways. (1) The unit proved 
highly reliable and required no repair^. (2) the teachere found it 
to be a much more efficient way to administer points; (3) it made 
enforcing negative sanctions ouch; less avatsive to the' teacher^ 
and (4) it was also effective in social consequation since all 
lights are visible to all subjects. Thus the children may compete 
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among themselves to be high-point person for the day, to beat a 
friend in total points, or to earn a toy before another individual. 
Also, during group reinforcement, all children cooperate to receive 
group points. The children can quickly see the child's light 

i is out and rhus responsible for their failure to earn a poi'if:, 
Thus it combines an avers 1* e stimulus (peer pressure) with positive 
reinforcement (points). 

Indivi dual Work Bex* The individual work box was originally 
developed by Patterson (1965a) for use with individuals in the 
regular classroom. The work boxes in the ELP Classroom were 3" x 
3 M x 5" boxes powered by a six volt battery. The front of the b<r: 
contained a green light and a red light and corresponding plus 
and minus counters. The teacher or experimenter controlled the 
box from a hand-sized control box at the end of a 25 foot cord. 

The length of the cord allowed the controller to stand in the ob- 
servation room and manipulate the lights and counters on the box 
without being visible to the child. The boxes were found to be 
extremely effective when used for: (a) attending behavior; 

(b) ideosyncratic behaviors; and (rj a follow-up strategy in the 
regular classroom. The boxes were effective since they allowed 
for immediate consequation of behavior, served as an for appro- 
priate behavior, and removed the social element from the punish- 
ment process. 

Puring the first weeks that the subjects were in the class- 
room, the work boxes were placed on their desks. Each child was 
that the box would help him to work and earn points. As 
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long as the green light stayed on he could earn points. The 
green light meant he was behaving and working appropriately. 
However, if the red light came on he was doing something wrong 
and if the red light stayed on for any time he would lose points. 
The red light might come on for any number of things which are 
considered not attending: looking s round the room, watching some- 

one or something, playing with an object, doodling, laying head 
on desk, etc. 

After a verbal explanation of how the box worked, it was 
demonstrated for the child. The teacher or experimenter then 
moved to her observation station. The child was given one point 
immediately if his behavior was appropriate. Following the 
initial point, points were awarded on a variable interval sched- 
ule (see Behavioral Program). 

In shaping attending behaviors the rules were always verbally 
specified. Once attending was under good control, the boxes were 
used for any ideosyncratic behaviors recorded for a child. For 
these behaviors the rules may be verbally specified or the behavior 
may simply be shaped in through successive approximations. The 
choice would depend on the type of behavior and the length of 
time available. Some of the behaviors modified using the box 
were: head tic, excessive movement in chair, finger tapping and 

babbling or talking to self. The work box was also used in the 
regular classroom with a peer reprograming maintanence strategy 
(see Section 4 ) . 
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• > Individual sixty minute timers, place on each child n 

desk, were used in a variety of ways to meet the specific behavl^ril 
nr**** o a ch child. The timers were particularly effective in 
controlling high luco diotr^otibllity . All the children were 
placed on timers (or work box) v?hen they entered the classroom. 

The instructions to the were that ho was not to look up 
from his task during that interval in order to receive points (r?- 
inforcers). The schedule was increased gradually (see. Behavioral 
Program) from a time interval the subject could originally accomo- 
date to a time-interval compatible with regular classroom require- 
ments. This technique was based on the assumption that introducing 
a stimulus incompatible with distractions, which functions as an 
S D for a reinforcing event, will lead to the response of academic, 
production. As soon as each child 1 s attending behavior reached 
criterion the attending timer was removed trem hi9 de 9 k and ho 
could car*; his points on the display board at the front of the 
coon, To increase the potency of "getting on the display board," 

*;;ie teacher made an announcement to the entire class when each 
child met the criterion. 



Once the attending timers wore removed from the child's 
deck th L .y were used for attending only intermittently as n behavior 
check. However, for any subjects needing to increase their academic 
production rate, timers were placed on the desk and labeled ''academic" 
timers. Thu9 the teacher would set the timer and require a certain 
amount of work to be completed before the time expired and the 
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buzzer sounded. Because of the multiple uses made of the timers, 
the children were not to set ^heir own timero. Thus if the child 
in any way touched the timer it was considered inappropriate 
behavior. 

• Group timer . An electric, Gra-lab Universal interval timer 
with an eight-inch diameter face was used to record and control 
group attending behavior, (see Group Strategy) The dial numbers 
represent from one to sixty minutes. By setting both the minutes 
and seconds hands it could be determined exactly how much time had 
expired. An audible click signalled when the specified time inter- 
val was complete. 

Outdoor timers . The children could normally earn or lose one 
point tor an entire physical education period. With some of the 
groups, it became necessary to more closely monitor p.e. and recess 
periods. If the group engaged in large amounts of arguing they 
had to earn p.e. period by not arguing. 

The experimenters obtained small two hour pocket timers for 
playground use. They could easily be held in the hand, pinned 
on a shirt or attached to a subject’s belt loop on his pants. 

The timer was set for five minutes. If all subjects cooperated 
during the five minutes they could stay out an additional five 
minutes. This procedure continued through the 30 minute p.e. parlo< 

It was discovered that getting to wear the timer was very re- 
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inforcing to all the children. Thus the person with the highest 
number of daily points by p.e. period was chosen to wear the time*.. 
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Recording Sheets . Heavy emphasis was placed on recording both 
teacher and pupil behaviors in the classroom setting. This recording 
was not only necessary for research purposes but it also gave 
constant feedback co the teachers regarding effectiveness of 
intervention. Listed hare are the sheets used by the teacher and 
teacher aide to record and monitor behaviors. 

1. Tine-out and suspension sheet (See Appendix A). Record 
was kept of the time and reason each child was placed in time-out 
or sent home for the day. In addition, behavior of the child 
following the consequence was recorded by the teacher. Thus if 

a behavior continued to be repeated or the behavior did not im- 
prove following the consequence it was assumed the consequence wan 
not effective and was altered. 

2. Point sheets, (See Appendix A). These sheets were placed 
cm each child 1 8 desk to record points. The point sheets were u*ied 
only until the child had earned the right to be on the display board. 

3. Weekly point record (See Appendix A). These sheets were 
records of number of points earned and lost daily, total number of 
points accumulated, and number of points traded for prizes. 

4. Record of individual behaviors (See Appendix A), During 
the first week of cla38 the teacher and teacher aide identified 
behaviors for each child, apart from the behaviors common to the 
whole group, which were either incompatible with classroom work or 
had been identified by the classroom teacher or peers as annoying. 

The behaviors were recorded to determine the frequency. If the 

0 

frequency was high attempts were made to alter the behavior. 
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Usually a first step was making the child aware of the behavior 
by having him actively involved in the counting process (or 
counting an incompatible behavior) or keeping a teacher recorded 
tally on his desk. If this did not effectively reduce the fre- 
quency additional variables were manipulated. 

5. Point record form. (See Appendix A). In preparation for 
returning the subjects to their regular classes, during weeks six 
through eight, points were not given following each appropriate 
behavior. During weeks six and seven they were given three times 
a day and during week eight they were given once a day. The 
teacher used the point record form to record daily points earned 
so they could be put on the display board at the appropriate time. 

6. Record of teacher behaviors. (See Appendix B) On the 
comer of each child's desk was a small 3x5 index card with the 
heading P (praise), TI (teacher initiation) and PI (pupil initiation). 
Each time the teacher or her aide would praise or in some way inter- 
act with the pupila, a mark would be made on the card in the appro- 
priate column. Each adult involved used a different colored pen 

to be able to distinguish her ma^ks. From this the teachers could 
determine the amount of praise given, the number of times atten- 
tion was initiated to students and to which students it was given 
most frequently as well as the number of times individual students 
initiated. As a result of this the teachers were able to dis- 
tribute their attention equally among students, increase praise 
to some students, and perhap9 put a question limit on those who 
O lemanded too ouch time. 




17 



16 



The children were not told the codes on the card. They ware 
simply told the teachers were counting their own behaviors.^ 

Academic Program 

Each group of six subjects was phased into the classroom in 
pairs during a one -week period; two on Monday, two on Wednesday 
and two on Friday. Each pair replaced two subjects from the 
previous group. This method of staging the entry of the new 
subjects made it possible for "old" subjects to orient the "new- 
comers" to classroom rules and routine and to serve as models for 
appropriate behavior. It also allowed the teacher time for close in- 
dividual attention to both appropriate ^nd inappropriate behaviors. 

Three major tasks were performed on each new student’s first 
day in the classroom: (a) orientation to the physical aspects of 

the classroom 5 (b) orientation to classroom rules and procedures; 
and (c) diagnostic testing of reading and arithmetic skills. 
Orientation to the classroom consisted of taking the child on a 
tour of the facility, including the observation room {discussing 
the one-way window), the time-out room and the store. Orien- 
tation to classroom rules and procedures consisted of a teacher 
led group discussion of how points were earned and what behaviors 
resulted in loss of points, time-out or suspension. Also discussed 
was the classroom time schedule for activities including recess, 
p.e., lunch, etc. and functional details concerning the use of 
red tags and daily assignment sheets and speclsl materials (to be 
discussed later). The rules were repeated a total of three times, 

0 
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once at the 5 addition of each new pair of subjects* From that point, 
the rules were never formally repeated, but applied to the sub- 
ject's behavior. 

Diagnostic assessment of reading end arithmetic skill strengths 
and weaknesses were obtained through the administering of two tests: 

(1) Gates-McKillop Reading Diagnostic Tests, form I and II, and 

(2) Sta^ f ord Diagnostic Arithmetic Test, form X and W, level I or II. 
The Gates-McKillop Tests were chosen because they offered a func- 
tional assessment for instruction purposes due to the range of skills 
tested as well as including standardized indices of functioning 

in terms of grade level. The tests were not used in their entirety, 
but rather, the most crucial elements pertinent to the modes and 
materials of instruction x/ere extracted for measure. The test 
parts used were (a) Oral Reading, (b) Knowledge of Word Parts 
(Giving Letter Sounds only) , (c) Recognizing the Visual Form of 
Sounds (Vowel part only), and (d) Supplementary Spelling Test. 

The form of the test, I or II, used for the first testing situation 
was arbitrary a9 long as the alternate test was administered at 
the end of the eight-week treatment period. The standardized in- 
dices of functioning made it possible to measure gains produced by 
the treatment model. 

The Stanford Diagnostic Arithmetic Test was chosen for much 
the same reasons as the Gates-McKillop; to channel instruction and 
determine level of functioning. The blending of modern math and 
more traditional problem types in the Stanford Diagnostic Test 
also made it more appropriate since the experimental class subjects 

19 
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came from varied backgrounds and the ELP instruction more closely 
resembled traditional math instruction in the basic skills areas. 

The computational part of the test was given on the first day with 
each child working at his own desk with a timer set by the teacher 
for the specified time interval. The concept portion of the test, 
testing counting, operations, and place value was given orally to 
the whole group as soon as the new group was complete and all other 
preliminary testing was completed, level I of this test was used 
most often, primarily because the subjects tended to be functioning 
well below grade level and to have begun with level II would not 
have sampled the subjects’ range of performance. In those cases 
where level II was warranted, It was given after level I and by 
necessity on an individual basis. The complementary test to the 
one given the first week of the program was administered at the 
end of treatment, making it possible for measurement in terms of 
grade level gains. 

The function of testing was to determine where the subjects 
stood academically, and how the materials could best be used to 
concentrate and maximize instruction to challenge strengths and 
develop needed skills. Each child, in the beginning, was given 
work that he could perform fairly independently; well below frustra- 
tion level in most subject areas. The purposes for the gradual 
beginning were* < a ) the point system, accompanied by teacher praise, 
could be maximized resulting in students experiencing success and 
the classroom setting becoming reinforcing; (b) attending behaviors 
could be established Sand (c) students could become accustomed to 
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classroom routines such as moving from one task to the next with- 
out waiting for teacher directives. After these essential elements 
were well formed the content of instruction became more challenging. 

Typical Day . When the students arrived at the classroom at 
approximately 9:20 a.m., they would quickly and quietly put their 
lunches and coats away, sharpen their pencils, sit down at their 
desks and begin work immediately after examining their daily assign- 
ment sheets. Each child's assignment sheet (see Appendix C) was 
prepared for the next day in the afternoon after class was dis- 
missed. The assignments were made on an individual basis according 
to the quality and kinds of work that had been completed to that 
point. The current days work and assignment sheet were used as 
a reference for filling out the new assignment sheet. The assign- 
ment sheet told the students in step-by-step order the exact 
pieces of work they were to complete on that day. All the books 
and materials needed (except for extra credit options) were like- 
wise placed in order on the right-hand comer of the desk with the 
assignment sheet on top. As each assignment was completed the 
student placed it on the right-hand side of the desk for marking 
and continued to the next piece of work. Papers were marked and 
returned as promptly as possible. Papers had to be complete^ 
neatly and correctly before points were given. Students were not 
punished or adminisfeed for mistakes but shown methods and given en- 
couragement. 



Insert Figure 2 About Here 
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For Turposes of illustrating how the assignment sheet was used, 
Figure 2 is a copy of a typical sheet for a fourth grade pupil. The 
first major heading on the sheet i3 math, below that are sub-head- 
ings: flashcards, worksheets and mathbook. The child, upon look- 

ing at his sheet, would see that his first task for that day was 
flashcards, addition and multiplication. He would take his cards, 
practice them to himself until he felt confident, then place them 
on the left-hand corner of his desk to signify to the teacher that 
he was ready to be timed. All completed work was to be placed on 
the left side of the desk ready for teacher attention. If a 
te r:htr was free, she would go over to the student and time him for 
cne-half minute on each set of cards. The results were then graphed 
on a bar graph on the student 1 8 desk. If a teacher had not 
been available the student would have gone directly to the next 
task, worksheets. The flashcards and any other comp^ced work had 
to await the teacher's availability. However, the more immediate 
the correction, providing feedback and reinforcement, the more 
effective the instruction. The five worksheets consist of four basic 
fact sheets; one addition, one subtraction, one multiplication and 
one division and one extra worksheet, in this case, perhaps working 
with place value. The basic fact sheets were used to increase rate 
and accuracy. The student was asked to fill in his name, date, his 
starting time and his ending time. An estimated time was placed 
in the upper left-hand comer. The student's goal wa3 to beat that 
time. Originally a child could get a bonus point for completion 
within the time period. As points were reduced he had to complete 
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the assignment within the time period to get the point for com- 
pletion. 

When worksheets were completed the student usually had an 
assignment from a math book. This allowed for practice in copy- 
ing and writing both problems and answers. Placement cues on the 
answer sheet were gradually faded out by the teacher. After com- 
pleting math this student would begin his reading assignments. 

He would go through his Hegge, Kirk and Kirk drill, read his Palo 
Alto book and then go on to his Sullivan workbook, writing answers 
on a separate piece of paper. The drill and the reader were always 
read silently first, then orally with a teacher to work on word 
attack skills and check comprehension. Sullivan assignments t/ere 
completed Independently and corrected by a teacher* The student 
was usually given a one ov two page optional assignment that 
could earn the child an extra point. 

Each child was given a new spelling list each day. Sometimes 
they were from a regular spelling book and sometimes they were 
teacher prepared lists. This particular child had a list of ten 
phonically regular spelling words next in his stack. He was to 
.Look at the words, write each twice and study them for a test. 

The test could be teacher administered or students could take turns 
giving each other their tests. Points in this case were given for 
both taking and giving the test. 

In language, the child was to complete the specified pages 
in his Dr, Spello book and a ditto, perhaps, working on homonyms. 

0 
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The penmanship assignment was from a formalized series and was to 
be completed on special paper which was provided. 

Once a child had gotten to this point on his sheet, he had 
completed all of his regular daily assignments, including all 
corrections* He could then go to the extra credit column and choosrs 
from the activities available to him. These options varied with 
each pupil and may have included any activities which proved re- 
warding for students. Group work was introduced after the subjects 
were all attending well individually, usually in the third week. 
Group work was introduced primarily because much of the work in a 
regular classroom Involves sitting and listening rather than the 
active responding of programmed instruction. Also our data from 
the regular classroom indicate that seldom do children get re- 
inforced except during recitation periods. Thus by reinforcing 
active recitation in ELP with points, it was possible, to increase 
the probability of recitation in the regular class and thus of re- 
inforcement from the regular classroom teacher. Because of a 
limiting time factor, such subjects as Science, Social Studies, 
Health and Art were limited to extra credit (optional) categories. 

In the event that the student did not finish all his assign- 
ments during the class period he was required to complete the work 
on his own time at home. The student’s admittance to the classroom 
the following day was contingent upon completion of the assignment. 

In order to get a teacher’s attention in a regular class- 
room the usual procedure io for the student to raise his h^nd and 
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wait, hand waving in the air, talking to peers or ga2ing out the 
window until the teacher responds. In the ELP classroom in order 
to avoid this time wasting procedure a different signalling 
system was instituted. The student placed a red tag on the left 
side of his desk vhen he needed help* The value of this procedure 
was that even though the student's red tag was out he was expected 
to keep working until a teacher was free to help him. This meant 
that if a student was stuck on one assignment, he was to go on 
to the next and come back to the trouble spot when the teacher 
stopped. Another important factor was the manner in which the 
student placed his tag on the desk. If slammed down, put on 
the wrong side, waved in the air or otherwise used incorrectly; 
no teacher response would follow until the student himself correct- 
ed the situation. Hand raising was used only in group discussion. 

The very structured, basically formal mode of instruction used 
in the classroom seemed to develop as a natural outgrowth of the 
treatment model. Both students and teachers reported being com- 
fortable with it. There was never a question of what to do 
next. 

The final evaluation of the academic program for each pupil 
was based mainly upon post-tests in reading and arithmetic. A 
fairly extensive final report, complete with academic and behavioral 
re co emendations was prepared for a final conference with the 
child’s patents, regular teacher and other school personnel from 
his own school. 
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Evaluation of Materials . Below are listed the programmed 
and non -programmed materials used in the classroom setting, in- 
cluded also, is a brief description and evaluation of each. 

1 . Sullivan Associates Programmed Reading Series, McGraw-Hill 
This program is divided into four sections. Programmed Pre-reading 
and Programmed Reading Series I, II and III. The total program 
ranges from pre-reading symbol sound cards and workbook to selections 
from classical myths at a sixth grade reading level, Basically 

the program is such that students read the materials, respond to 
them and immediately check their responses. Supplementary activities 
and materials are suggested in the teacher f s guide for maximum 
development. The program has several advantages* it is pro- 
grammed (it progresses slowly, repeats, calls for instant recall 
and reinforces correct responses), it contains a very humorous, 
high -interest story line and it makes independent seat work poss- 
ible. The pace is perhaps too slow and the variety of content is 
somewhat limited. This series would not be recommended for use 
as a total classroom reading program. 

2. $. R. A. Reading Laboratory, Elementary Edition . This is 
a program designed to gradually increase reading comprehension, 
skills and speed. The set is divided into three parts, power build- 
ers, rate builders and listening. Each of the first two segments 
are color coded according to sbility levels ranging from fourth to 
seventh grade. The basic procedure is for the child to real a 
passage or short story, answer questions by writing in a special 
booklet and check responses by comparing his answers with those on 
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a special answer card. Only the power builder segment of this 
program was used in the ELP classroom, and only by the most capable 
students. In most cases the students' skills had not developed to 
the level required by this program; or else, they had been pre- 
viously over-exposed, leading to lack of interest. 

3. iiie Palo Alto Reading Program, Sequential Steps In Reading, , 
Harcourt , Brace and World. Inc., 1968 . This is a very effective 
phonetically developed reading series containing individual reading 
books and corresponding workbooks. The books for this program are 
small 50-60 page paper bound booklets sequentially numbered from one 
to 20. In a very careful, systematic way, this program introduces 
vowel sounds, consonant sounds and rules governing both. The 
program can be individually p^ced and is applicable to first 
through sixth grade reading abilities. The stress on phonetically 
regular words is very useful in developing word-attack skills. 

4. Checkered Flag Serl > o» Henry Bamraan and Robert Whitehead 
Field Educational Publications, 196$ . This is a reading series com- 
posed of six hard bound books, each about racing and race cars. 

The minimum reading level requirement is at least fifth grade. 

Each book, besides the story, contains chapter comprehension check 
questions. This aeries, with its high interest stories, functions 
very effectively as a remedial tool. 

5. Remedial Reeding Drills. Hegge. Kirk and Kirk, George ,_Wghr 
Publishing Co. , 1969 . This spiral-btund paper back drill book 
contains sounding-out, word-attack skill development exercises. 

T he progression from drill to drill is a very gradual one, emphasizing 
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one sound at a time* This Is a very phonetically regular material 
which would be effective In Initial Instruction as well as In 
remediation. It also provides a good source for spelling words. 

6 . Webster Company^ Classroom Reading Clinic, Webster 
Division , McGraw-Hill Book Co.. 1963 . This set contains story and 
comprehension cards 6uch as that In S.R.A. reading series, Polch 
word cards. Conquests In Reading , The Magic World of Dr. Spell o,. 
and a set of eight paper-back novels. Of these Dr. Spello and the 
paper back book editions lended themselves most successfully to 
the program. Dr. Spello Is most appropriate for grades three to 
five, and could be used for language development as well a3 spell- 
ing. The paper-backs required a minimum reading level of fourth 
grade, they were used mostly for supplementary extra credit read- 
ing and frequently were chosen Instead of library books. 

7. Lessons for Self Instruction In Basic Skills. California 
Test Bureau . These materials are branching programmed booklets on 
subjects ranging from basic math processes to '’Following Direct- 
ions”. Each booklet is programmed so that a correct response 
meets with a smiling face and new problem, and an incorrect re- 
sponse meets with a frowning face and a rediscussion of the process 
involved to clear up misconceptions. The programs work most 
effectively as reviews on supplementary activities. They are fun 
for students. However, they do not effectively teach new skills. 

In addition to the materials listed above, several other 
materials were employed and modified according to the various needs 
of students. Among these were basic fourth and fifth grade math 

28 



L 

* 



books, SRA math work* *~ks, basic fact rate sheets (Haughton) , 
mimeographed math and language arts materials, and Webster basic 
spelling books for grades four, five and six. 

Behavioral Program 

Attending Behavior . Enrollment data (Behavior Checklist and 
baseline observations) indicate that the majority of the candidates 
had very low levels of attention (attention span) to appropriate 
academic stimuli (see Results Section). 

Martin and Powers (1967) report that the most frequent defin- 
ition of attention span is ''the length of time a person can attend 
to one thing." According to this definition attention span is 
both manipulable and improvable, "...task perseverence , or a long 
attention span, is primarily a function of presenting reinforce- 
ment contingent upon attt Ing behavior, and allowing incompatible 
behavior to go unreinforced (^Martin and Powers, 1S67, p. 567. V 1 

Moyer and von Haller Gilmer (1955) measured attention spans 
for normal children ages 18 months to seven years and found them 
to range from seconds to forty-five minutes. They defined attention 
span as the length of time the child played with a toy, chosen 
from six take-apart toys. 

Attention spans have been increased with retarded children 
(Birnbrauer, Bijou and Wolf, 1963), brain injured children (Kerr, 
1962; Patterson, 1965) and normal children (Kennedy and Thompson, 
1967; Allen, Henke, Harris, Baor & Reynolds 1967; Walker and 
Buckley, 1968). Attention spans in young hyperactive children not 
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only can but should be increased. Attwell, Orpet and Meyers 
(1967) report that "attention' 1 was of particular importance in pre- 
dicting reading ability. Since much of a child's academic day 
is spent "sitting and listening" or working with possibly non- 
challenging materialo, it is extremely important that he be taught 
the basic requirement for any assignment — to attend. 

The response measure in this study was established in accord- 
ance with Martin and Powers (1967) operant conditioning analysis 
of attention span. Attending behaviors for the subject involved 
looking at the assigned page, working problems, and recording 
responses. Non-attending behaviors were defined as those behaviors 
which were incompatible with task-oriented (attending) behavior. 

The following observable behaviors were classified as non-attending 
events (Walker 6 Buckley, 1968): **(a) looking away from the text 
and answer sheet by eye movements or head turning; (b) bringing 
an object into his field of vision with head and eyes directed 
toward paper (other than pencil, book and answer sheet necessary 
for the task); and (c) making marks other than those necessary 
for the task (e.g. , doodling). 1 * Using this criterion, most of the 
ELP subjects had baseline attention spans of under three minutes. 

All children were placed on a variable interval schedule for 
attending. To facilitate teacher implementation of the variable 
interval schedule, random time assignments were made on 3 x 5 
cards. A random sampling without replacement design was imple- 
mented by drawing numbers from a pool of predetermined numbers. 
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Thus a variable interval (VI) of three minutes ranged from one 
minute to six minutes; a VI 4 ranged from one to eight minutes; 
a VI 5 from two to nine minutes, etc. Table I amalgamates the 
separate lists* 

Insert Table I About Here 

In praOtiie a child's timer (or teacher controlled work box) 
was set for a schedule the child could function within, based on 
previous observations of the child. For most of the subjects this 
VI 3. Even if a child was attending extremely well, the 
teacher was to begin with no higher than a VI 7, (None of the 
44 subjects v/ere attending at high enough levels to begin above a 
VI 5). Six subjects could not successfully complete a one-minute 
interval of attending so were set up on schedules ranging from 
20 to 60 seconds at the onset. 

Once the child Successfully completed a given time interval 
he was awarded a point. The teacher crossed th interval off her 
list and set the timer for the next time interval. However, if 
he non-attended during the interval, his timer was reset. Tallies 
were kept of the number of times the timer was reset for non- 
attending. If it was reset more than three or four times for 
any one interval, it was assumed the interval was too large and the 
child was placed on a lower schedule. 

Theoretically a child could progress in orderly fashion through 
the eight schedules to criterion* However, flexibility was built 
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in so that a chil ’ progressing slowly would repeat the schedule. 

(If the timer was reset on several occasions but not enough for 
the child to be placed on a lower schedule.) On the other hand 
a child who did extremely well on the schedule could be skipped 
from one to three schedules ahead. 

After the child successfully completed the VI 10 schedule in 
one day, he was placed on the display board. Some children 
achieved criterion in as little as three days. All children must 
have reached criterion by the end of week two or their points were 
cut in half. With close teacher attention to attending behavior 
this goal can be achieved by all children. Thus it becomes as 
much a function of teacher behavior as child behavior whether 
criterion is met. 

Points and 6ocial praise were adjusted to insure a child would 
continually try for higher levels of attending. The prestige of 
getting on the display board was also an important factor in 
shaping attending. Once on the display board, the subjects were 
given points for attending on a VI 10 schedule. For weeks three 
through five this was raised to FI 20^ and for weeks six through 
e f £ht to FI 30. 

Reinforced System . The academic and social behaviors of 
children vho function productively in a regular classroom setting 
are ordinarily under the control of a wide variety of generalized 
reinforcers appropriate to that setting. Solving problems, com- 
pleting assignments, and achieving success at academic endeavors 
generally function as powerful reinforcing events which maintain 
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academic behavior. Such behaviors are further strengthened as a 
result of the parental and teacher administered praise that often 
accompanies appropriate academic behavior (Hall, Lund, & Jackson, 
1968). It is net surprising, then, that the behavior of most school 
children is responsive to traditional educational procedures and 
methods even when no systematic efforts are directed toward gaining 
behavioral control. 

The "acting-out" child, however, complete with accompanying 
academic disabilities, often misses out on these avenues of pos- 
itive reinforcement common to the educational setting. Reinforce- 
ments for appropriate academic behavior are rarely available for 
him. The low probability of success and/or praise being associated 
with his academic behavior decreases the frequency of academic 
behavior in a spiraling process, e.g., the fewer the reinforce- 
ments, the less academic work attempted, the fewer the reinforce- 
ments. In addition, many of the social behaviors demonstrated 
by such children are aversive and thereby preclude or severely 
limit the prob3blity of the child being positively reinforced by 
teachers or peers. 

In order to reverse this process, it is necessary to use 
additional incentives to make appropriate classroom behaviors more 
reinforcing to the subject and at the came time reduce the rein- 
forcing value of deviant behaviors. Tangible reinforcement for 
appropriate behavior has been ahovn to increase resistance to 
forgetting (Jones, Edmonds, and Mueller, 1966) and to facilitate 
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discrimination learning among older children (Cross and Vaught^r, 

1966) as x*ell as alter behavioral variables previously mentioned. 

The total token economy is designed to increase these positive 
classroom behaviors and reduce the probability of occurrence of 
deviant behavior'. 

Individual Relnforcer System . In the Engineered Learning 
Project, individual points could be earned for appropriate academic 
behavior (task completion, correct answers on tasks, completion of 
specified units of academic work in relation to time) " ^pro- 
priate student behavior (raising hand, not talking, 1 ork 

without talking, task attending). During the initial of 

treatment, subjects were reinforced for minor approx i 1 l o 

these appropriate behaviors on a nearly continuous b ee 

Appendix D) 

During the first six weeks of treatment subjects 
points for each piece of work they completed. They c 

point per page and an additional point if done with 1 uracy. (In- 
dividualized assignments allowed for the criterion A :• i racy) . 

They also received points for attending, walkl g . < rs 

appropriately to out-of-classroom activities, p.e, am >n to 

the classroom quietly and beginning work. Their maxi 
score each day was 25. They received points ironed 1 » r the 

completion of a task throughout the day. 

Points could be exchanged at 1:00 p.m. each day ft vHual 

stimulus items. There were six levels of point valr^ i< *»e items, 
ranging from 25 points to 200 points with occasional items 
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for 500 points. The values for these reinforcers v;ere selected 
to approximate their purchase price e.g., 25 points would be need- 
ed for toys costing 20C to 39c ; 50 points for toys costing 40C 
to 65C; etc. The advantage of using a large number of back-up 
reinforcers is that it Increased the probability that at least one of the 
stimuli would be relevant to the deprivation conditions of the 
various subjects (Ferster & DeMeyer, 1962). The minimum interval 
of time necessary to earn the minimum stimulus (lowest point 
value) was approximately one day during the first five weeks 
assuming the child was completely task-oriented during this period. 

The subjects were free to exchange their points for an inexpensive 
item or to accumulate them for a more expensive one. There was 
no evidence of an inability to delay gratification and save for 
higher prizes. Their academic production remained relatively con- 
stant whether receiving immediate exchange for toys or saving them. 

Points were awarded on the basis of concurrent schedules 
(Morse, 1966). Subjects could receive points on both a variable 
interval schedule of reinforcement for task-attending behavior and 
a fixed ratio (FK 1) for completion of assignments. 

Group Reinforcer Strategy . Deviant behavior in the classroom 
setting is sometimes reinforced by approval and recognition from 
peers (e.g., giggles, comments, gestures). A group reinforcing 
climate controls this source of reinforcement by making it more 
desirable to encourage peers to behave appropriately than in- 
appropriately. Group contingencies have been used by a number 
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of investigators in the classroom setting (e.g., Barrish, Saunders, 
Wolf, 1969; Schmidt and Ullrich, 1969; Bushell, Wrobel and Michaelis 
1968). Mithaug and Burgess (1967) compared individual reinforce- 
ment to group reinforcement for a complex cooperative act* They 
found that group reinforcement alone was not effective. However, 
the highest rate of responding was achieved with a combination of 
individual and group reinforcement. 

Once all the children in the ELP classroom were on the 
display board they could begin earning group points. Group points 
operated for two 30 minute periods daily during academic assign- 
ments. During this time the teacher aide sat at the side of the 
room controlling the timer and observing all children closely. 
Initially the entire group had to attend well five minute 
periods for each point. This was increased to ten minutes after 
the children t^ere performing well at the five-minute level. ^ 

If the entire group was task-oriented (using the same criteria 
as for individuals) during the time specified they received a group 
point and the timer was reset for another interval* If at any 
time during the interval, one or more of the children r .re not 
task-oriented; the timer hands were placed back on the starting 
point and not restarted until the deviant behavior was terminated. 
Group points were recorded on the display board as they were 
earned. When the criterion number of points was reached the group 
was taken on a trip to an activity of their choice. The total 
number of points necessary varied among the groups, subject to the 
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fixed so that each group, if working well, had the opportunity to 
earn at least one trip. 

The institution group points was effective in making a 
highly desirable reintorcer (trips) available while simultaneously 
providing aversive control in the form of peer group pressure 
against individual deviant behavior. (Patterson & Anderson, 1964) 

While the use of tangible reinforcers can greatly facilitate 
learning and appropriate classroom behaviors it is not » e only 
variable necessary for an effective token economy program. 

Kuypers, Becker and O'Leary (1968) instituted a token program only 
in an adjustment class of six third and fourth grade children. 

They concluded, 

M A token system is not a magical set of tools 
available to the teacher concerned with im- 
proving the behavior of children. The full 
set of equipment is needed to do the job right 

r p. 108';." 

Social Reinforcement . Contingent use of social reinforcement 
has been shown to increase achievement (Stein, 1969); study be- 
havior (Hall, Lund & Jackson, 1968); and appropriate classroom 
behaviors (Madsen, Becker 6 Thomas, 1968; Thomas, Becker 6 Arm- 
strong, 1968) among normal elementary school children. 

When social leinforcement is^ available , there is some evidence 
which suggests that adult praise is aversive for "acting-out" 
children (Levin and Simmons, 1962). Such research shows social 
approval or praise often has little desired effect on these 
children while negative consequences such as social disapproval 
and verbal sanctions, applied to disruptive behavior by teachers 
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and peers, servji to maintain these behaviors in the education 
setting. However, research evidence is accumulating which suggests 
that the contingent use of teacher attention and praise can reduce 
deviant behavior (Becker, Madsen, Arnold, & Thomas, 1967; Ward & 
Baker, 1968). Social approval and attention, while not initially 
desirable for some children can take on reinforcing properties 
by the systematic pairing of approval and p^aise : with token ro- 
inforceis. 

In the ELP classroom, social reinforcement in the form of 
attention, approval, praise, interest, and affection was paired 
with token reinforcement in order to transfer stimulus control from 
contrived rrinforcers to those reinforcers more often available 
in the regular classroom and to build up responsiveness to social 
reinforcement through the process of generalization. 

0 T Leary (1969) reports that his research indicates children 
in grades one through four can make the transition from token to 
social reinforcers within three or four months without a loss of 
appropriate behavior. The data presented here indicate that 
this can occur even earlier. 

Aversive Consequences . 

The reinforcement procedures used in the treatment setting v?er£* 
supplemented by aversive consequences which were applied to certain 

classes of deviant behavior. (See Appendix D) 

Response Cost . Response cost is simply the removal of a re- 
inforcer which has already been presented to the subject as a 
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consequence of the subject’s behavior. As such it functions as a 
mildly aversive stimulus in controlling behavior. As a punish- 
ment procedure response cost has proved extremely effective in re- 
ducing responding in adult subjects (Weiner, 1962, 1963, 1964a, 
1964b, 1965; Siegel, Lennke, & Broen, 1969). The results indicate 
an immediate and nearly complete reduction in responding following 
response cost. Response cost has also been shown to be effective 
in reducing disruptive behaviors in a "pre-delinquent" rehabilita- 
tion center (Phillips, 1968) and the classroom (Mclntire, Jensen, & 
Davi9, 1968). 

The authors previously found when response cost was introduced 

following an inappropriate response there was lmmedlCwe suppression 

of the response. However, this attenuation was accompanied by a 

sharp rise in other inappropriate responses which could be described 

as emotional behaviors (Walker, Mattson, Mattos, Walken & Buckley, 

1967). It was mentioned at that time that these results may have 

been due to the human agent involved. 

"...social aggression appears to result when an individual 
is punished by another individual but not when the admin-^ 
iscration of the punishment is directly mechanical p. 1 / ' ,r 

Results from the use of the electronic display board in the 
ELP classroom for administering response cost would substantiate 
this point. Subtracting points proved extremely effective and 
eliminated the need for verbal comments by the teacher. Non- 
attending and talking without raising hand and securing permission 
resulted In point loss. 
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Time-out * Time-out refers to "an arrangement in which the 
occurrence of a response is followed by a brief period of time in 
which a variety of reinforcers are no longer available ; Patterson & 
White, 1969, p. lj" Extensive use has been made of time-out in 
animal research (Leitenberg, 1965) and single subject designs 
(e.g., Wolf, Bimbrawr, Williams & Lawler, 1965; Risley, 1968; 

Bur chard & Tyler, 1965; Wahler, 1969; KcReynolds, 1969; Bostow, 
1969). Most successful procedures for imp amen tat ion of time-out 
with young children involve isolating the child in a small non- 
reinforcing room for a short period of time. 

In the present study, time-out from a reinforcing climate was 
used to consequate such behaviors as talking out, throwing objects, 
out-of-seat and inappropriate verbal behavior. VJhen one of these 
behaviors occurred, the child was required to go to the time-out 
room adjoining the classroom. During the time a subject was 
placed in the isolation room, he was unable to receive points, 
attend to the class, or work on an assignment. The group reinforc- 
ing cliracte was immediately terminated when a subject wa9 placed 
in time-out and remained suspended until \e re-entered the class. 
When the child had spent ten minutes in the time-out room, his 
timer rang and he was allowed back into the reinforcing climate 
prevailing in the classroom. 

The average number of times the time-out room was used per 
subject in each treatment group was seven. That represents .88 
times per v?eek per child. Results from the ELP classroom sub- 
stantiate those of Tyler and Brown (1967) indicating that time-out 
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is especially effective in terminating deviant behaviors before 
they become disruptive. 

Suspension . For highly disruptive behaviors such as fighting, 
leaving the building without permission, foul language and gestures, 
disobedience and/or defying the teacher, creating a disturbance 
during time-out, or accumulating three time-outs in one day, the 
child was suspended from school for the remainder of that day or 
the following one, depending on the time in which the incident 
occurred. Readnission to the classroom was made contingent upon 
the subject’s successful completion of all regularly assigned 
academic tasks at home. In addition, all individual points were 
lost for the same period, the group reinforcing climate could not 
operate during this time, and parents were instructed to prohibit 
recreational activity and television viewing while the subject 
was absent from school. Suspension was normally used one or two 
times per group during the first few weeks of treatment and then 
rarely, if ever, used for the remainder of treatment. The tech- 
nique appeared to be quite effective in suppressing such behaviors 
as teacher defiance, verbal abuse, fighting, and tantrum behavior. 
Brown and Shields (1967) have found the same technique to be 
successful with grades K-cight. 

Classroom Schedule . During the eight-week treatment period, 
there were a few significant changes in the overall acadcmi* 'gram. 
These changes were (a) increasing output demands; (b) integration 
into a regular fourth or fifth grade class for physical education 
and noon recess land (c) gradual reduction of number of points and 
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As the eight weeks progressed, increasing demands in terms of 
quantity and difficulty of tasks were placed on students, basically 
due to their increased academic and behavioral skills. (See Appen- 
dix E) 




The integration procedure usually began during the fifth week 
of treatment. This sometimes varied, however, depending upon 
the development of the particular group. Up to this point, all 
p.e. and recess activities x*ere limited to the six pupil group, 
in isolation from other classes. The purpose of integration was 
to further work on the skills developed in the small group setting 
by applying them to a total class situation. Since the students 
in their regular classrooms were forced to interact within large 
group settings this integration was deemed necessary. 

As treatment progressed and these behaviors cane under 
control of the response-reinforcement conditions operating in 
the treatment setting, the frequency of reinforcement was re- 
duced and the ratio between amount of academic production and 
amount of reinforcement was gradually changed uutil the subjects 
were producing large amounta of work for small amounts of tangible 
reinforcement. Reducing the amount and frequency of reinforcement 
and shifting to a variable interval schedule near the end of 
treatment was designed to facilitate the generalization and per- 
sistence of treatment effects into the regular classroom setting. 
During the sixth week, in preparation for return to regular class- 
room, the maximum point total was dropped to 20, and points were 
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awarded only three times a day. The children no longer received 
points for each piece of work completed but rather received 
points for completing a whole category of assignments e.g., math, 
reading, etc. By the eighth week, their maximum total was reduc- 
ed to 15 points. These were tabulated and put on the display board 
only at the end of the day. A staging technique was again used 
to phase the subjects back into the regular classroom and to 
introduce untreated subjects into the special class. 

Observation and Recording 

Graduate students in education, interested in working with 
exceptional children, served as observers throughout the various 
special and regular class phases* Before beginning to collect 
data, each new observer was given a copy of the observation form 
and manual to read and master. Once the categories were memorized 
to the satisfaction of the observer, he was brought into the ob- 
servation facilities to practice taking observations# The nev; 
observer worked with the experimenter or observer trainer during 
a trial period. The authors also made a video-tape of a previous 
group of subjects which was used in the training process* When 
each observer felt comfortable with his coding, the trainer took 
simultaneous recordings to check reliability. 

Reliability was calculated by scoring each interval in terms 
of whether the two observers agreed or disagreed. By the percent 
agreenent method, the number of agreements was divided by the total 
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number of observation intervals to obtain the reliability 
coefficient, for an agreement to be scored in any one interval, 
obseivers were required to agree on the behavior code (15 cate- 
gories) as well as the type of agent response (8 categories) that 
consequented the behavior. 

In measuring reliability of an observer's recordings, no six- 
minute observation form was counted in which only one behavior 
occurred. For example, if the child sat reading for six full 
minutes each row would simply have one code — attention to individ- 
ual work with no response by agent. Since many one-category 
intervals occur in the special class, and they are easy to record, 
it was felt their inclusion would inflate the reliability co- 
efficient. 

Criterion for an observer was .90 or above agreement with 
the trainer for a one hour period (ten observations). In general 
the training process required one week (one hour sessions per day). 
Generally the new observers spent two days practicing and three 
checking reliability with the trainer. The average for the gtoup 
of observers was 21 practice observations prior to meeting 
criterion. 

It was found that weekly spot checks on reliability were 
necessary to maintain inter-observer agreement. This was necessary 
because the behavior of the children changed over time and with i*. 
the requirements of the observer changed. 

Behaviors were recorded every 15 seconds for a six-minute 
oeriod. To determine the passage of time, interval timers were 



mounted in clipboards. Vt the end of each 15-second period a 
"bleep 11 was heard in the earphone and a light mounted in the 
clipboard flashed. This was the signal for the observer to record 
the behaviors and move to the next interval on the observation 
form. 

The recording form for the two year period was revised from 
a form originally devleoped and tested by Ray, Shaw and Patterson 
(1968). Each coding sheet provides the following information 
for a six-minute period: behavior of the subject, social con- 

sequence, agent supplying consequence, and description of the 
classroom situation. 

The rating form has 15 columns for classroom behaviors. Twenty-four 
corresponding rows represent 15-second intervals. The ob- 
server records and then moves down a row each time a 15 -second 
interval is complete. During each 15-second interval the obser- 
ver records both the behavior of the subject and the social con- 
sequences of his behavior. The observer may code more than one 
subject behavior and more than one consequence during each 15- 
second interval. 

The description of classroom behaviors and agent responses 
are presented in Figure 3. The complete manual and form are 
presented in Appendix F. 

Insert Figure 3 About Here 

The observers were instructed to make continuous recordings for 
the six-minute sheet. Thus if the child left the room or the 
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observer was interrupted during a six-minute period, the record- 
ing sheet was discarded. 

Observations of the subjects were taken in the regular class- 
room prior to enrollment in ELP, during treatment, and for a two- 
month follow-up period. Patterson, Shaw and Ebner (1969) report 
that obtaining between 40 and 150 minutes of observation yields 
reliable data with the current form. Baseline data for each 
subject consisted of a minimum of 60 minutes in the regular 
classroom over a two week period. 

During treatment three observers, recording one hour each, 
obtained daily observations for all academic periods. Each ob- 
server, recording behaviors for one child at a time, was instruct- 
ed to begin recording with any child on a random basis. Once a 
six-minute observation vas complete they were to move to the next 
child in seating order. This sequence was to continue for their 
entire hour. Among the three observers between 21 and 30 obser- 
vations were collected daily. Thus each child was observed for 
approximately three to five six-minute periods daily for a total 
of 18 to 30 minutes. Changes in classroom scheduling, and illness 
of observers and subjects reduced the total number of observations 
for the eight week period to an average total of 64 observations, 
or 6.4 hours per subject. 

Follow-up observations in the regulav classroom were obtained 
bi-weekly at random times during academic portions of the day. A 
minimum of 32 observations (192 minutes) were obtained for each child 
during post treatment data collection in the regular classroom. 
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Tr e a tmant Ef fci _ n_ 

An analysis of variance for a repeated tr.ca^uir^ design (Miner, 1962) 
was used to eualyzf* the basol:..ic and ir-aatmcrt data for all 44 experi- 
mental subject ?.. Scores iox tsacli subject were the raeai peitenCn^n of 
appeopv tate behavior produced during baseline rt.d. tr^ali'icr t. Each data 
.✓point in baseline was based on an average of J0 ; *vr- 7 *i.vuto observations 
taken in tbe regular cles^rocn. Treatment scores were based on an avevafcu 
of 64, si\ -minute observations taken in f e oxperlne ite’! clrrsroon. 



The F ratio of 4fiu,?.L in Tabic i iud'.cates the intervention procedures 
in the experimental cins9rccn produced a very powerful treatment 
The mean percentage of anpicpr iuln btnwior for all 44 subjects i;i base- 
line was 44.59. During trcrciieni: , i:he mean percental? of appropriate 
behavior for tbe sane oaojacts was 90. 2 n 

The treat mm.’: ovogra r «'tf fec-ei variability in behavioral rate9 

across subjects. For example, during baseline the mean percentage of 
a, *?»\vniate behavior varied from 20 to 67. Dwvv.ig treatment, it varied 
from 79 to 99. V c standc^a deviations for f-Aperirv icsl subjects ivt 
baseline and treatment ware respectively l:w;l cud 4*59. 

During the first week la the experiment. 1 classroom eech subject 
was given the ftanford Diagnostic Arithmetic Test ml the Gates-McKillop 
Reading Diagnostic Test, ^ring the last week in the experimental class- 
room, after two months of treatment, each subject was given an nltornate 
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Insert Table 3 About Here 

The F ratio in Table 3 indicates that treatment in the experimental clar*s 
room substantially altered the subjects 1 measured achievement in math. 

The Trace, grade equivalent score for all 44 subject? on the pre-tcct was 
3.5. Tl.a me a:i grade equivalent score for the same subjects on the 
post- test was 4.5. Achievement ranged from grade level 1.5 to 5-2 on 
the pro-te.>t and from 1.5 to 6.5 on the post-test. 

Insert Table 4 About Here 

Inspection of Table 4 reveals that the subjects' measured achievement 
in reading was also substantially changed. 'Jhile the effect was rot 
as powerful as that produced in math achievonrnc , it was statistically 
tlnnif leant beyond .001. The mean grade level score in reading on the* 
-re- test vas 30. On the post-test it was 4.5. Mean achievement scores 
ranged from 1.3 to 7.5 cn the pre-test and from 1,8 to C.G on the post- 
tc-U . 

Inter-Sub ject Replications of the Treatm ent Model 

The treatment model, consisting of the primary treatment variables 
oC token reinforcement , social reinforcement, end aversive control pro- 
cedures, was applied to eight groups of deviant subjects in grades 
three, four, five, and six over a tv^o-year period. Each of the eight 
groups provided an independent, inter-subjcct replication of the treat- 
ment modal. 

o 
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Insert Table 5 About Here 

Tcble 5 presents the mean percentage of appropriate classroom behavior 
in baseline and treatment conditions for each of the eight replication 
groups. The mean percentage of appropriate behavior, in the baseline 
condition, varied from 35.00 to 51.83 across the eight groups. During 
treatment, means for the same subject groups varied from 85.33 to 93.50. 
The effect oi the treatment model was to increase the amount of appro- 
priate classroom behavior produced across all eight replication groups. 
Exposure to the intervention procedures also sv /stantially reduced the 
amount of inter-group variability in appropriate behavior over the base- 
line condition. During baseline, the mean difference between the lowest 
end highest group was 16.83 percentage points; whereas during treatment, 
the largest mean difference was 8.17 percentage points between groups 
five and eight. Ranges for individual subjects within each group were 
also reduced during treatment. For example, the greatest range during 
baseline was 50 percentage points for suujects in group number five. 
Subject three in this group averaged 25 percent appropriate behavior dur- 
ing baseline. Subject six in this same group averaged 75 percent appro- 
priate behavior for the same period. One reason for the large range 
among subjects in the mean percentage of appropriate behavior produced 
in baseline can be attributed to the topography of the behavior for which 
different subjects were reterred. For example, some children produced 
relatively high rates of appropriate behavior in their classrooms. 

However they were referred primarily because of acting-out behaviors 
that occurred at a low frequency. These behaviors included teoper 
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tantrvtns, teacher defiance^ fighting, non compliance , and disrupting the 
ciasstocm, Other children referred to the project rarely engaged in the 
high intensify behaviors listed above, However , they produced high 
r^teo of nor-study behavior such a;> r.oisy, cover. -:rt .**ir.::nd the room- 
not-attcndd ng and peer initiation. 

largest range for subjects during treatment was 12 percentage 
points in group number one. Thus, an additional effect of treatment was 
to increase the within group f s homogeneity in amount of appropriate class- 
room behavior produced. 

The r.eans for groups number one and five reflect Eha process cf 
training the experiments] class room teacher in behavior modification and 
classroom management techniques. Group number one is the first of f ( u * 
.croups rotated through the experimental classroom for a two month period 
during the 1968-69 academic shcool year. Similarly group number five is 
the first of four groups rotated threugh the experimental classroom dur- 
ing the 1969-70 school year. Two different teachers were used during 
;he fo school years, Neither teacher had applied experience in b*hro»lrr 
m; !t£i cation techniques. Thus, both teachers were trained on the first 
group of subjects, groups one and five, that were rotated through the 
.txperi^ cni:al classroom luring each academic year, Tu Table D the loves t 
are for groups ore and five, However the difference between these 
me 3ns and the combined ticatwent mesns ox SO.*!', 1 for ?ll eight groups J.o 
negligible. Tim, the M ccst ; of training each teathxt in effective 
application of the treatment model vas very email. 
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Insert Table 6 About Here 

Table 6 presents the mean pre-test and post-test grade equivalent 
scores cn the Stanford Diagnostic Arithmetic Test for each treatment 
group. The effectiveness of the treatment model in increasing measured 
achievement in math is replicated across the eight groups. The largest 
mean gain of one year and eight months was produced with experimental 
group number six. The smallest mean gains of approximately six -months 
were produced for experimental groups two and five. 

Unlike appropriate classroom behavior, application cf the treatment 
model, did rot reduce the amount of inter-group variability in measured 
achievement in math. There was an actual increase in this variability 
during treatment. During baseline, the difference between the means 
for the highest and lowest groups was 8.3 months. During treatment, the 
different 2 was one year and 4.4 months. Although th 2 treatment model 
produced substantial increases in achievement across the eight grouP 3 , 
the effect was much less reliable than for appropriate behavior. Thic 
result suggests a less than perfect correlation between appropriate 
behavior end measured achievement. 

This result also suggests that academic achievement, as measured by 
standardised tests, is much less sensitive to the application of treat- 
ment variables than is appropriate classroom behavior. In a rtudy by 
UalVer , Uattson, and Duckley (1°6 0 ), in which attending behavior was the 
dependent variable, the systematic v’ithdrawal and reintroduction of token 
reinforcement, social reinforcement, end aversive control procedures 
produced differential effects in amount of appropriate behavior recorded 
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durinf, experimental and control phases. This dependent measure thus 
proved very sensitive to manipulation of independent treatment variables. 

Tn addition repeated measures of corefully defined classroom behaviors > 
such as attending, by trained observers provide a much more reliable 
and stable estimate of performance than standardized achievement tests 
that sample one unit of behavior at fixed points in time. 

Another factor that could account for the increased variability in 
achievement is the complexity of the behavior involved. A number of 
specific skills are subsumed under the tern "academic achievement" • 
Proficiency in these skills would tend to vary greatly across individual 
subjects. It i3 possible the treatment model had a substantial impact 
upon certain classes of these skills and only minimal impact upon other 
classes. Thus the distribution of a subject’s proficiency on these skil's, 
upon entering treatment, could mediate the impact of the treatment model 
in improving his measured academic achievement. Inspection of Table 5 
reveals soma overlapping of the lower end of the pre-test and post-test 
ranges. For groups four and five, the lower end of the ranges are exactly 
iha same. This indicates that the treatment nodel had absolutely ro 
effect upon the measured, math achievement of one subject in each of these 
groups. Since the treatment model was applied uniformly across subjects * 
it is possible the treatment model's effect upon these subjects’ achieve- 
ment was mediated by their initial skill levels. Some subjects referred 
to the project for treatment v?ere r.o deficient in basic skills areas that 
they could not tell time, did not know the alphabet, could not do simple 
addition or subtraction, and d?d not know the multiplication tables. 
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yen" r.f these subjects imnvo^cd in these areas during treatment. Hownver, 
the changer, veto not powerful enough to be refJerred on a standardised 
achievement test. 

Insert Table. 7 About Here 

Table 7 presents the nea i pre-test and post-test grade equivalent: 
scores on the Gates-NcKillop Rep.ding Diagnostic Test. In contrast to 
math achiever ant , the inter-group variability in reading achievement 
was slightly greater on the pre-test than the pont-vnsfc. The lei gas t 
mem difference be Lire on the eight groups on the pre-test was one year 
end 9.3-months ox the post-te9t, it was one year and 8.7-months. 

The smallest mean gain in reading achieve wept ’-as 2.4-months Sr ox 
experimental group eight. The largest mean gain wa3 one year and 6.3 
months "or experimental group one. Thia compares to six months for 
groups two and five end one year end eight iron t hr for group six in natl; 
ac h I eve roc.' t . 

Chaii£»^s_ in Acad eTic J&ajiojs 

Rate. per minute was used to monitor and record subjects' perform '“nee 
on such academic activities as oral reading rets, rate correct or multi- 
plication flash cards, and r *te correct on batic math facta. 

Daily records shewed substantial changes in rotes of these behaviors 
during the treatment period. Because of the sheer enount of data in- 
volved, the difficult^ associated with summarizing ruch data and th j 
costs oi reproduction i these data ore not included in the final report, 
howivor, copies c J 11 be furnished to the reader upon request. 
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Z' s i' r. £h np 3 qf> A cros s lpdl*»i du al Cl ass r o or Beh av lore* 

?!n addition to changes that treatment produ^d in the proportion of 
Am* subjects engaged in appropriate classroom behnviev * the experi mentors 
war? :’n terns i: 5 .1 in the effect of the treatment model upon Individual 
classes of behavior between baseline and treatment conditions. O'hr.Evy 
?nd Drab nan V*)1Q) discuss this Issue in relation to studies retorted <r> 
the literature. They argue that changes in individual behaviors in 
token systems ire ol experimental interest and that simply reporting cut 
overall percentage of time spanc in appropriate behavior masks these 
changes, ’’Thu frequencies of individual classes or oubcatogories of 
behavior have usually not been reported,,," They further state that 
"...in the token studies, such data does not exist* rod one can only 
speculate about such behavior changes ( p. 15j ' 



Tsbic C y resents the average rate per minute cf the 44 subjects on seven 
individual behaviors during baseline and. tree threat. The. sever behaviors 
are listed as: noisy, aggressive , non -at tending, peer initiation, 

initiation. to peer, movement, and inappropriate task, tilth the except io:» 
of noii-at tendi'.ig, these behaviors had very lc-r bascllr.c ratoa. However* 



the treatment: model was very effective in decelerating these lew bnoe 



rat? behaviors* for example, peer initiation and Initiation to reer were 
decelerated fvon rates of approximately five nrui six responses every l;e .• 



minutes t<> rates cf four responses every thousand minutes. Although chango s 



in these two behaviors were the most dramatic, noisv, aggressive. r.cr~ 
nttondiig, movement, and inappropriate task showed similar decreases 
in r2te par minute. 



I insert Tabic C /.hoot fl=.r c? 
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NciV-ot tending bad the highect baseline rate of *t>y of the seven 
Ir.o.opropr:,ai_o behaviors. In bas^Iina, its average rata across 44 subject! 
was approximately one and a hair responses per minute. During trealmen; 

:he rate ,T ar reduced to approximately one non-attending event per tvo- 
rcinute time period. As defined in the observation schedule, all these' 
behaviors are ir compatible with study behavior- Thus, reducing the rate^ 
of these behaviors nrovides the necessary setting events for building in 
and reinforcing behaviors that are compatible with learnirg and successful 
academic performance. The treatment model was designed to weaken behaviors 
that actively compete with learning and performance and to simultaneously 
strengthen behaviors that facilitate these processes. Results of the 
study indicate that this effect was produced in the experimental class 
setting. 

j '-X par im a nt el Ar a lysi s o£ Tr eatnent ' k>d el Compone nts 

liejults of tlr± initial application of the treatment model indicated 
the*' the intervention procedures we^a very effective in producing behavior 
change and in modifying deviant: classroom behavior. These data, however, 
do not provide information about which components of the treatment model 
were instrumental in producing the behavior charge. It is possible, for 
example, ^h 3 t only one or two variables accou^' for the m’jcr portion o' 
^nriince in the trenvrant oulcome(s). It is also conceivable that the 
behavior change dc.cenlr, rpon the interaction of a series cf tPese var- 
iables or that the change is cue to other than treatment variables such 
as st^rajli specific to the trei fnetit setting. (Teachor-s tudeut ratios, 
individual attention, teacher skill, special materials, novel stimulator. 
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or change in settings). The specification, control, and evaluation of 
all variables that could possibly effect treatment outcome(s) in an 
applied setting would be practically impossible. How®yer, it is poss- 
ible to specify those variables that have been manipulated in the treat- 
ment process and which can logically be assumed to have a caudal re- 
lationship to treatment outcome. A probe technique was used to evaluate 
the effects of three treatment model components upon the academic and 
social behavior of a group of five subjects. This experiment was con- 
ducted during the 1967-68 academic school year and was designed to provide 
data on the influence or weight of a series of independent treatment 
variables upon the dependent variable of attending behavior. The 
specific question to be investigated was the extent to which these 
variables controlled or accounted for variance in behavioral rates. 

The results of this experiment are only summarized here. Complete details 
of the experiment are contained in the interim report: U. S. 0. E. 

Grant £0EG 4-6-061308-0571 Assessment and Treatment of Deviant Behavior , 
Bureau of Education for the Handicapped, 1968. 

Insert Figure 4 £bcut Here 

Figure 4 contains the results of an experiment which evaluated the 
components of token reinforcement, social reinforcement, and aversive 
controls in the control of behavior in n special class setting. The 
data in Phase I record the performance of the subjects with all 
controls operating. This phase lasted until the behavior of all 
subjects stabilized at high rates. During Phase II all token rein- 
forcement dispensed through both individual and group reinforcing 
climates, was withdrawn. This procedure had very little effect upon 

O 
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initially substantial impact on subject two's behavior and a very 
dramatic irpact on the behavior of subject five. However, the behavior 
of both subjects returned to its original level after several day3 end 
remained there until Phase II Was terminated. Token reinforcement wp/ 
reintroduced during an intervening reinstatement phase designed to ratus ■ 
the behavior to its original, preintervention lev'll of stability. 

During Phase III, all social reinforcement was controlled within 
the classroom environment. The effects of the withdrawal of thin ccm- 
poneiYC :nre not immediately reflected within the data; perhaps baceuss 
it took the subjects some time to discover that the social re in for cement 
had, in fact, been withdrawn. The withdrawal produced a marked in- 
crease in the variability of the behavior of ell subjects, indicating 
that this variable exercised powerful control over the subjects' attend- 
ing behavior. Thin phase was terminated at the end of two weeks whan 
it b GC ame obvious that the subjects 1 behavior was not going to rctuva 
to its original level or stability (as in Phase I) with this variable 
withdrawn. When social reinforcement wau reinstated, the attending 
behavior of all subjects immediately returned to its original level of 
stability and remained there until the beginning of Phase IV where all 
aversive controls v;ere withdrawn. The removal of time-out and suspen- 
sion, as aversive controls, had differential effects upon the ci»bjc«:tr 1 
behavior. SuMect thiols attending behavior wa c . rn.jarentiy not unde: 
♦he control of ^bese aversive stimuli. In last, his behavior during 
this period vax slightly mora stable than at arm* other time, during 'hu 
experiment. Though slightly less pronounced than the effect of removing 
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social .*ein Cor cement , ihe withdrawal of s’ 1 1 aversive controls indicated 
th^.t lho.se components accounted f or large amounts -f -'ariaaca in be- 
havioral rates and were very effective in controlling the behavior of 
subjects in this experiment. The aversive controls "ere reinstated 
after a two -we eh period and the. experinar.t was terminated at this pow.it. 
The *onaivid?.r of the treaanant period ccnsisted of preparing the sub^e:'. 
for full-tim* entry into the regular classroom. 

Insert Table f » Above Mere 

Table '? contains *he ma "in scores on d standard deviations for the 
group of cub loots during each c.xper. ’rental chase. Although slightly 
more variable following experimental intervention. "h* behavior of °\1 
subjects "at vary stable during Phases I and l r . The group’s attending 
behavior was most variable during Phase IV n:d lowest, i terms of mean 
score y during p hase III. This inter-subject variability , however, in 
very misleading when usad to evaluate the effect a of experimental inter 
vtnMon, Thn inter-subject variability in Phases II, ITT. and lV ie 
■ipyroximatc 1 v the same ^ vir Figure 4 indicates thet verv dif fr rantinV 
effect*: were ‘i/roduced in the subjects’ int * i -gubjoct variability* follo"- 
irg ’*1 tiiara’ T nl of the respective c/vncnentrs The withd'cval of lo!<cn 
reinforcement bed T *»ry 3 it tin effect u n on the sublet s’ behavior. V* \ 
variance in the data we? attributable to the beb^W^r of oily t"o 
subjects. The data Jo ^bans III show the caue in ter- .subject variability 
as those in Phase II: yet inspection of Figure 4 ind 4 c?.t*" the 

nobv-u' variability of those same Into clearly ?ntehlishes nuclei re- 
inforcement as the moat potent component o" the treatment nodal In 
Q ontrolling attending behavior. 
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The effects of withdrawing token reinforcement w.:rn r ether nnrxx 
Token reinforcement was apparently exercisin', much weaker control over 
the social and academic behaviors of the subjects, at this point in 
the experiment, chan the authors had estimated. Tf all token reinforce- 
ment had been withdrawn during the initial stages of treatment , tbo 
authors suspect its effect upon the subjects 1 behavior would have boon 
much mere narked. The subjects* appropriate behavior was aoparertly 
under the control of such intrinsic reinforcers as academic success, 
social approval, individual attention, task mastery, and positive ''eon- 
back by the time token reinforcement was removed. 

The da a appear to bo in direct contrast to the evidence provided 
by Levin and Simmons (1962a) which suggests tnat adult praise did nc i 
ex^reJrc control over the behavior of fif:een emotionally disturbed 
males between the ages of 7.2 and 11.9. A second study, Levin sr »r f-im*,-,.. 
(If6?b), which alternated food reinforcement and social rainfovctmmt 
oi ?ucc5*nn:lv^ trials, indicated that praise sowed so an aversive 



stimulus ratuor than a? a positive rein forcer let these subjects. 

/rai/.n rs well na expressions of nositiva ?_\\ r.agctivr. feedback, appro- 
vaj , ft too tioji , affection, and interest by tie teerner were controlled 
in Tba~o. HI of the present study. These stimuli not t«nl/ appeared to 
bo no?;- cveroiva for tncen subjects, they were, in fact, highly to- 
infercing and fjnctirnrd es '^ery ;vvc ) fr.l controls of their appropriate 
. ociel cud aradmic behaviors. This result is con jis tent with the r ir. - 
\ngs of clhcr experimenters in the field who have used l octal ve'r force 
nent effectively in controlling oeth tbo so^irl a;;e academic •».-*havlrvr, 
of children, in the c lr screen, laboratory, and clinic setting (All or . 
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Hatt, /Ivo.Il, Harris, Wolf, 1964; Harris, Johnston, Veliev, Wolf, 3%&' 
Harri , Wolf, B^er, 1964; Roche**, Vcdsen* Am:l(* ; Thomas, 1967: Hall 
and Prod'Mi, 1067; Fall, Irani, Jackson, 19u8; Thj-sres. Becker, Armstrong, 
3968), 

Withd'Va'T.il from a ret n:\vv’ ry ol:-r rv':a coyK 'r-’-c' 1 !: u>jc. trc *" v ::c;'ufr;\ .. r 
of deviant or inappropriate behavior is a fotui of punishment vhich v/as 
most e F cec*vJv* Jn controlling and modifying this class of behevJor in tbs 
experiment. This technique net only decreases the probability tha^ 
these deviant } eheviors '7l.ll occur fits v;itadr;j'rl increased this orob- 
ebilify dua tug the experiment), it terminates disruptive, deviant 
behaviors very rapidly. As a result ; the systemati c anplicati.cn of 
time-out can fraction as a very powerful lu^r/ng -end centre] device l: 
clrrrroom settings pro^id^d that the ctlmrte of these classrooms is 
teinlorciir'. 

Thin experiment provided only a gross evaluation of the trv Hin-jn': 
r.odcVu comconcntr. It should bo. carefully ^cplicf.tod before its 
result*: ace gcnetclisnd and anpliec! to the response class of actlr.p.-oiU; . 
disrimtive behavior in children. In addition* such dichotomies na indi- 
vidu?1. versus group reinforcing climates and t ime- versus susvensiou 
^ay produce differential effects in the control m *3 modification nf 
jehr-vlor- The internet Lon between various cor .binotions c f these varlan. »s 
ray r Inn bo i r'ucial t actor in producing bc-br.vio' change. Additional 
oxperiir.ents will have to ev?lur.i c these interactions before the fun- 
ctional role 1 3 enshins which exist between behavioral ^nd tveMr.cnt 
’’eria^cs arc* r.len'-ly established c.nd precisely described. 
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application of the treatment model to the ». ?hc\ir*r cf 44 subject' 
over a two year period produced me;sutohlt: changes in rvpropvrla to cj «.«■■:■• 
f orii behavior, inath a chi ever ant , and reading achievement. These effect 
’^ere replicated on eight groups or -objects l’ocaceJ through the exper- 
iment .1 eia^n setting during a £»■?! month period. Thro* ccrr meats of 
the troattccri model, token, reinforcement , fiocirJ. r:\inrorcewent- and 
aversive controls were evaluated in terms of their efficiency ov yc*i*o£ r .:*. 
in %c :o\nt I; ^ for var5.rmce in social and acadetr r: b~h .-vie? . H-'ovJt? >u- 
rflnatftd diet social relnforcreut ex3C*:tv.=d the graitteof control over the 
su; vents* be v a\i;r while .^vernjve ni/Acr^ls rvlghtlv less ef fective 

in controlling the sar.e behavior. After five . f ::rr.« r^snt: t-’- 

inh : *■ •'■ * "'.-‘'h **' " t'Vi- . o.tv - >r ' in ~atif' v cad 

;-v , -r-'^r' -*>f •-Li 'ahl-ict • >-d ; v- i -r octroi, :ij *'1' hot.-- y.l., 

■■ toiv ■ ’“■ ; r o'*c7' ‘iei i f v^ver-d of, •* •* ~inir " . "“■’Oticn r s' f'V* 

cubiec.**:,' : ^.riing hcMv:. 
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Footnotes 



1. This research was supported by a grant from the U.S. Office of 
Education, Division of Research, Bureau of Handicapped Children 
and Youth. U. S. 0. E. Grant #OEG 4-6-061308-0571 Assessment 
and Treatment of Deviant Behavior in Children. 

2. Four subjects moved from the school district either during or 
immediately following treatment and thus were not included in 
data analyses. 

3. In a small number of cases the child's behavior had been so 
aversive to the regular classroom teacher that he or she re- 
fused to allow the child back ^nto the classroom at the end of 
the day. In addition, the third graders normally were dismissed 
earlier at their elementary schools so there was not enough 
time for them to return to their classes following the 

special class. 

4. The authors have found that not only do consequences fox posi- 
tive behavior occur at a low rate but con sequences for inappro- 
priate behaviors occur vary infrequently as well in most class- 
rooms. Even among teachers who are doing a good job in the 
classroom, there is a reluctance to do ary more than ^warn’ 1 

or reprimand the child despite the data indicating the ineffec- 
tiveness of verbal reprimands (e.g., O r Leary, 1970). A 
possible suggestion for this is that the teacher is often pun- 
ished by the child for applying sanctions. The child may 
shout comments, stick his tongue out, etc., leaving the teacher 
little recourse but to ignore the behavior. In our classroom 
any of these behaviors resulted in additional point loss. Thus 
the children quickly learned to inhibit the behavior. It is 
important, however, that the teacher remain neutral it. her 
facial expression. The children quickly pick up when the teacher 
is angry end are reinforced for "bugging the teacher. ,r 

5. From subject comments it can be assumed that none of the child- 
ren learned the code categories. Subject comments also indic- 
ated they "liked" the idea of teachers having their behavior? 
counted too, and would report whether the teacher had a "good" 
or "bad" day (often incorrectly) on the basis of the number 

of tally marks . 

6. The schedule was changed from a variable interval to a fixed 
interval during week three since it was easier to allot time 
periods for the teacher, in actual practice it becomes a VI 
schedule because the teacher fits the schedule to her academic 
work and thus randomly over- and under-shoots the exact time. 
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7. The small time Interval required for earning a point was 

because of the rigid definition applied to attending behavior 
by the authors. If any child looked up from his paper or 
stopped working it was considered noj-attending. 




69 



TABLE I 



Variable Interval Schedules for Levels of 
Attending in the ELP Classroom 
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Table 2 



Summary of the Repeated Measures Analysis of 
Variance of Baseline, and Treatment Scores 



Source 


SS 


df 


MS 


F 


P 


Total 


54,522 


87 








Subjects 


4,520 


43 


45,95!; 


488.21 


/ 


Treatments 


45,955 


1 


\.001 


Error 


4,047 


43 


94.13 
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Table 3 



Summary of the Repeated Measures Analysis 
cf Variance of Pre-Treatment and 
Post-Treatn.ent Achievement S coves In Math 



Source 


SS 


df 


MS 


j? 


P 


Total 


10,824 


87 








Subjects 


7,156 


43 








Treatments 


2,384 


1 


2,384 


79.73 


^’.001 


Error 


1,284 


43 


29.86 
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Table 4 



Summary of the Repeated Measures Analysis of 
Variance of Ti'c-Treatmcnt and 
Post-Treatment Achievement Scores In Reading 



Source 


SS 


df 


MS 


F 


P . 


Total 


27,946 


87 








Subjects 


22,286 


43 








Treatments 


1,746 


1 


1,746 


19.18 


\.00i 


Error 


3,914 


43 


91 
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Table 6 



Rate Changes In Individual Behaviors 
Between Baseline and Treatment 
Conditions, for All 44 Subjects 



Individual Behavior 


Ny 


- Ag 


Ma 


Pi 


ip 


Mo 


AW 


3aseline Rate 


.IS 


.02 


1.39 


.57 


.63 


.79 


.13 


treatment Rate 


.003 
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Figure Captions 




Fig. I 


Schematic Diagram of Treatment setting including outline o£ 
of child’s desk for work to be completed (1) ; completed work to 
be corrected (2); corrected work - points assigned (3;, and 
individual timers (4). 


Fig. 2 


Sample Copy of Daily Assignment Sheet for ELP Subjects 




Fig • 3 


Descriptions of Codes Used for Observation in All Phases 
the Engineered Learning Pro. 1c -t. 


of 


Fig. 4 


Experimental Analysis of the Effects of Three Treatment 
Variables Upon the Task-Oriented Behavior of Deviant 
Subjects in Grades 4, 5, 4 6. 
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Clssarooj Behavior* 



:iY (nolev): Coded whenever the sublect Is talking loudly, veiling, or making oti,er deliberate, 

Inaooroprlste nolee (such as hanging hn 0 V* or scraping chair hack and forth) which la actually 
or potentially dleruotlve to others. 

AC (aggression) : Actual or attempted phvalcal ahuee of another. Tohn hit# BUI or .John start* 

to hit BUI an4 la stopped by the teacher. Thla Included pushing , shoving, threatening, bossy. 

NA (not attending): Suhlect Is t.ot attending to his work or to a lesson helug taught, etc.* «*v be 
looking out tha vind'jw watching the obaerver or other children, drawing whan he Is supposed to 
he watching teacher demonstrate arithmetic, leaning down to tie Ml shoe, turning In bis chair. 

PI (pear initiation): Peer talks to, pokss or In some wav trvs for attention of 

IP (initiation to peer): S talks to, or In some wav trte for attention o' peer. 

(movement around room): Ceded whenever subject la moving around room (other than times when entire 

group la moving, as In transition Periods): ohaarver need not try to decide whether each move- 

ment la appropriate or inappropriate: that question Is hatter decided hv romper!.!* rate of 
movement across auhlect*. 

IV (In., roprlate task): Work on task not assigned or specified hv teacher for that time. 

NO (appropriate group behavior or normative behavior): Coded whenever tha subject's behavior Is task- 

dlracted activity which la appropriate for that tine and situation, included would he Ha tap- 
ing to tha teacher explain a lesson, painting during an art class, singing with others during 
Mile, lining up with the rest of the class to go out for receas, etc. The ohaarver ahould taka 
carp not to Include any behavior which might he more appropriately characterised as recitation. 

VK (work): A child may ha engaged In appropriate group activity hut not working e.g., observe a 

movie. Work means at desk on academic projacta . Must work on teacher assigned teak. Record 
when engaged In reading, writing, arithmetic, basic akllls. 

RR (recites): Coded whenever aubject recites, art were a teacher's ouestlons, reads out loud, glvss 

a spaach, or performs before tha claaa. 

VO (volunteers) : Coded whenever suhlect raises his hand or In some other manner Indicates a dsalre 

to racita or do whatever else tha teacher may heva asked for, e.a., aomeone to Pick up papers; 
may ha either in a claaa discussion or in a small group. 

TI (teacher Initiation): Coded v*en the teacher "calle on’ 1 th* auhlect or cornea to his deak or 

activity area to apeak to him; this interaction must be initiated by the teacher and not ha 
a response to an initiation by the euhlect. 

IT (Initiation to teacher): Coded when the auhlect indicates that he wants some attention from tha 

taachar; ha mev ralsa hia hand, apeak or go to her: this behavior la differentiated from "volun- 
teer ,r In that tha aubleet'a Initiation to the teachei is not In conjunction with class discussion, 
group study, or reciting. 



Agent Responses 

0 (no response): Coded when no response from teacher, Peers, or obssrver follows • behavior. Thera 

may he no response because the behavior does not demand one or hecaues tha auhlact la being 
Ignored , tha observer ahould note thla at tha atde rather than attempt to coda tha response 
any differently) . 

A (attention) : Coded whenever tha agent listen* to or looks at tha behaving auhlact: thla la a neutral 

kind of raaponaa v 1 th no obvious approval or disapproval In tha attending response. 

R (pTsfaa)i Coded when tha subject receives pralea or approval from «o agent: nav ha verbal behavior 
or consist of gasturaa, e.g., smiles, head nods, applause. 

C (compliance): Coded when subject compiles with a command from another. 

VC (non- compliance) * fodod when subject does not comply with a command from another. Neither C or 
NC will prohahlv ba used vanr often; If thav era, thav will ©rohablv ha resnonaea of tha auhlect 
to TI. 

FR ♦ or - (physical contact positive or negative): Positive physical connect would Includ* such bshav- 

iote as hups, pats on ths bsck; netatlvs physical contact would include aggresilva hahtvlera f tom 
an agent such as hitting, spanking, etc. 

D (disapproval) : Coded whan a auhlact behavior la followed hv varhel or fteatural dtaaonrovel from an 

Ment; a samel as might ha framing, negative head nods, ”*ou shouldn't hsva dona that,** ate. 
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A. Recording Sheets for Subject Behavior 

B. Recording Sheets for Teacher Behavior 

C. Academic Assignment Sheet 
D* Behavioral Program 

E. Classroom Schedule 

F. Observation Manual and Form 
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Deviant Response 
Re cora Form 



Bo havior of Child 

1. Not attending to task (failure to begin work when light extinguished) 

2. Talking 

3. Unauthorized walking or standing 

4. Throwing objects 

5. disobedience and/or defying teacher 

6. Fighting 

7. Leaving building without permission 

8. Foul language, lewd gestures 

9. Creating disturbance in T.O. or refusing to enter 
3.0. Other 

Teacher Response 
C - Cost 
T.O. - Time Out 
S - Suspension 

Behavior of Child Following Consequence 
1-10. v' Same as above) 

11. Appropriate behavior 

12. Pouting or crying 
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Week 1} 



WEEKLY POINT RECORD 
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BEHAVIOR RECORD 
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POINT RECORD FORM 



(Weeks 6-8) 

Name of Child Date 

Weeks 6-7: (20 pts. maximum) Give 3 times daily - 9:20-10:30 red marks ; 

10:30-12:10 blue marks; 12: 10-1: AO green marks. 

Week 8: (15 pts. maximum) - Give once daily. 



POSITIVE 



1. 


Completed Assignment 


( 2) 


Math 






(uk 6-7 +1 if 100%) 


(+1) 


Reading 








(+1) 


Language 








(+D 


Writing 








(+1) 


Other 


sub-total 


2. 


Attended to task 


(+D 


9:20 - 9:55 








(+1) 


10:30 - 11:00 








(+1) 


11:00 - 11:35 








(+D 


11:35 - 12:10 








(+1) 


1:00 - 1:40 


sub-total 


3. 


Entered classroom 


(+1) 


8:20 






appropriately 


(+D 


After P.E. 








(+D 


12:30 


fjub-total 


4. 


Exhibited socially appro- 


(+1) 








priate behavior* (Can 


(+1) 








apply to specific programs 


(+1) 








and other) 


(+1) 










(+D 




sub-total 



TOTAL POINTS EARNED 



negative 



1. Not attending 



(-1) 9:20-9:55 
(-1) 9:55-10:30 
‘(-1) 10:30-11:00 
(-1) 11:00-11:35 
(-1) 1:00-1:45 



sub-total 



2. Other inappropriate 
behaviors (specify) 



.<- ) 

(- ) sub-total 



TOTAL POINTS LOST 



0 
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Appendix B 



Record of Teacher Behaviors 




3 5 card on child’s desk. 

T. P. « Teacher praise 

T. I. ■ Teacher initiation 

P. I. « Pupil initiation to teacher 
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Appendix C 



.Jame. 



Date. 



Extra Credit 
FlfSISH ALL OTHER 
;'JOR!< FIRST 

Lkci 

i 

Flashcards t 

' ,'ORKS. IELTS ! 

‘AT. BOOK [ 

i 

I 

PEAOI L'G j 

Hegge, '(irk ?, Kirk Drill | 

Palo "lto; ' 

SULLIVAil! 

Conquests in °eading 
S. n . X 

Lippircott J 

Checkered Flag I 

ItelSTER 



STlfDY 'FORDS : 

Test 



Uiguag e 
Dr. Spello: 



Ditto: 



i 



j 

\ 
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FIemmamship 

Pages: 
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Appendix D 



Program for Altering Classroom Behavior 
ELP Experimental Class 



I. Reinforcement. 

A. Individual basis - 

1. Appropriate student behavior 
-raising hand 

-remaining in see.c and not talking 

-beginning work without talking upon entering classroom 
-walking in hall appropriately 

2. Academic - 
-task-oriented 
-completion of task 

-correct answers on assignments 

-neatness cf paper 

-(completion within time interval) 

B. Group reinforcement 

1. Clock timer will be set at selected time intervals each 
day provided all S*s are present in the classroom area and 
are engaged in task-oriented behavior. (If any £'s are 
out of the room for individual work, testing or teacher 
errands, clock may still operate.) 

2, A group payoff will be instituted when the group accumulates 
a pre-selected number of points. 

II, Stimulus Consequences of Deviant Operants 
A. Loss of points 

1* When behavior is inappropriate the S/fi light on the display 
board will go out. If the S_ does not modify his behavior 
within 10 seconds he will start losing points at the rate 
of one per minute. If the £ has lost all points earned 
for the day and still has not modified his behavior he should 
be placed in time-out. 

2. Behaviors which result in loss of points: 

a. Wot attending to task: 

-Looking at or manipulating a stimulus object not connected 
with assignment for more than 60 continuous seconds. 
-Laying head on desk so assignment cannot be seen. 

-Moving chair away from desk or leaning back so assign- 
ment cannot be seen. 

For the two preceding behaviors the light should be 
extinguished itnmed lately. 

b. Responding without raising hand and securing permission. 
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III. 



- 2 - 



B. Immediate exclusion from the class room area for 10 minutes 
(minimum) for the following operants: (S_ decides when he 

will return to the classroom area. If he decides to stay in 
it will count as second time out. The is not allowed to work 
on any assignment during time-out but must complete assignments 
during day.) 



Talking to peer 


4. 


Refusal to work after pts. 
to zero 


Unauthorized striding 


or walking 


5. 


Inappropriate physical initiations 
(punching, poking, tripping, etc.) 


Throwing objects 




6 . 


Other, non-tolerated operants 
falling within this class of 
behaviors 



C. Immediate removal from ELP building for the following behaviors - 
(If expelled during a.m. the will stay out for the remainder 
of the day and return the following morning. If expelled during 
p.ro* will remair home the following day.) Homework required. 



1. 


Disobedience and/or 
defying teacher 


4. Foul language, lewd gestures 


2. 


Fighting 


5. Creating a disturbance during 
isolation period (time-out) 


3. 


Leaving building 
without permission 




Behaviors to be ignored- 





-asking for help without raising hand 
-irrelevant questions 

-tapping pencils (unless disturbing class) 
-pouting and crying-(see HA for not working) 
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Appendix E 



ELP CLASSROOM SCHEDULE 



Week 1. 


All students on individual timers or work box. Begin with VI 
they can operate under based on observations during baseline and 
Day 1. Maximum should be VI 7 to begin. If interval is too 
large, cut back. Once a child has reached criterion of VI 10 
tcaedule in one day (not necessarily consecutive) he may begin 
receiving points on the display board. Prior to that time he 
uses the pink sheets. This would be continued into week 2 if 
necessary. Cost held down to make environment reinforcing. 
Maximum 25 points during weeks 1-5. 


VIeek 2. 


Use display board on CRF for academic and VI 10 for task attending 


Week 3. 


All Ss should be on display board. Any Ss whose behavior does not 
quality him for the display board should receive only one-half 
points until he is on display board. (12*5 pts. maximum.) 

Schedule for attending points weeks 3-5. 

FI : 20 9:20-9:40 11:20-11:40 

9:40-10:00 11:40-12:10 

10:00-10:30 1:00-1:20 

11:00-11:20 1:20-1:40 

Start group points as soon as all Ss are on display board. 


Week 4 
and 5 


Continue as in week 3. Behavior should be 3.33 plus on task- 
oriented (based on "WK 11 and "NO" categories - periods of over 2 
minutes "TI" should not be counted but another observation used), 


Week 6 


A, If behavior of all children 3.33+ in task attending reduce 
points to specified time blocks, e.g., 9:20-10:30; 10:30-12:10; 
1:00-1:45. Points earned for academic and social behavior 
given at these 3 twines only. Points subtracted at this time 
also. Maximum 20 points for weeks 5-6. 

Schedule for attending points weeks 6-8. 

FI :30 9:20-9:55 11:00-11:35 

9:55-10:30 11:35-12:10 

10:30-11:00 1:00-1:45 


Week 7 


Continue as in week 6, 


Week 8 


Display board on but no points given or subtracted until end of 
day. Points at end of day based on checklist during day. Maxi- 
mum 15 points per day. 


Week 9 


2 transferred on Monday 
2 tranr ferred on Wednesday 
2 transferred on Friday 
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Re -programing Project 
Oregon Research Init. 
September, 1968 

OBSERVATION IN THE SCHOOL: DESCRIPTION OF A CODING FORM 

R.S. Ray, D.A. Shaw, G. R. Patterson 

The following is a t rial-and-error refinement of a school observation 
technique used by the project’s observers during the past year. It is a 
method of "characterizing" school situations for a given chll.d in such a 
way as to facilitate understanding the determinants and consequences of 
social behaviors as well as the relationship of those behaviors to the 
classroom setting. 

Each coding sheet represents six minutes of behavior for a given 
subject. The "deviant" child may be compared to his "normal" peer by 
alternating the two as subjects cf observation. (We convent ianally 
observe the "deviant" child for 12 minutes (2 coding sheets) and then 
select a "normal" peer at random to observe for 6 minutes (1 coding sheet) 
before returning to the "deviant" child). Each coding sheet provides the 
following information: behavior of the subject, social consequence, agent 

supplying consequence, and description of the classroom situation. 

The rating form is set up as a grid. Each horizontal line in the 
grid represents a fifteen-second time interval. The grid is divided into 
tv 70 -rainute "chunks" simply for the convenience of the observer in reading 
the behavior codes. Using the observation clipboard set for fifteen- 
second intervals, the observer moves down one line each time he receives a 
signal from the clipboard, i.e., at the end of each fifteen-second time 
block, (If no clipboard-timer is available, a stopwatch or school clock 
will generally suffice.) The vertical spaces in the grid correspond to the 
behaviors listed at the top of the two-miv^te section. Durit g each fifteen 
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second interval the observer records both the behavior of the subject c id 
the social consequences of his behavior by placing the appropriate resprnso 
and agent codes in the space beneath the appropriate behavior code. The 
response codes and the agent codes are listed at the top of the coding 
sheet. For example, if the subject is not attending to the teacher's 
explanation of the lesson and the teacher "calls him down" (J.e., dis- 
approves) the interaction would be coded as follows: 

Ni AG NA PI IP MO IW NO WK RE VO TI H PL AL 

U_LL i LU lU !_Li LLJ 

Depending upon the rate at which things are happening in the classroom, 
the observer may code more than one subject behavior and more than one 
consequence during each fifteen-second interval. In most cases, however, 
there vrill be only one primary behavior or interaction. It i 9 not 
necessary to make more than one coding entry for behavior which continues 
unchanged throughout the fifteen-second interval. The subject's behavior 
during the fifteen-second period should be "characterized** by the coding; 
it need not be described in sequential detail* The observer should 
check the situation category at the right side of the coding sheet which 
best describes the situation during each 2-minute section. The categories 
are as follows; 

Classroom: 

Croup ; To be used whenever the classroom activity is 
essentially group rather than individual work, e.g., 
teacher presenting lesson to entire class, subject 
in a reading group, etc. 

Individua l : To be checked whenever the subject is Involved 

in individual rather than group work, e.g., sitting at 
desk doing arithmetic, reading; noc listening as a group to 
teacher or working together in a group. 
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Transltlo n: This category will generally be checked when 

the entire group is switching from one kind of activity 
to another, e.g., lining up to go to assembly, moving 
chairs to form a reading group* Frequently is movement 
associated but it would not be considered inappropriate 
in this situation, e.g*, entire class moving from desks 
to reading groups would be coded NO (appropriate group 
behavior) rather than MO (movement). 

Recess : Checked during any regular recess period whether child 

is outside or remains in classroom. A short description 
of the child r s activity should be written on the lines pro- 
vided at the right of each two-minute section (this applies 
to classroom as well r . s recess behaviors). Generally during 
recess periods, the observer will be primarily interested 
in coding either PL (playing with others) or AL( isolated 
from others) and possibly AG (aggression); other behavior 
codes are not so relevant to the usual recess activities. 

Description of Codes; 

CLASSROOM BEHAVIORS s 

NY (noisy): Coded whenever the subject is talking loudly, 

yelling, or making other deliberate, inappropriate 
noise (such as banging books or scraping chair back 
and forth) which is actually or potentially disruptive 
to others. 

AG (aggression): Actual or attempted physical abuse of 

another, e.g., John hits Bill or John starts to hit 
Bill and is stopped by the teacher. This includes 
pushing, shoving, threatening, bossy. 

NA (not attending): Subject is not attending to his 

work or to a lesson being taught, etc.; may be looking 
out the window, watching tha observer or other children, 
drawing when he is supposed to be. watching teacher 
demonstrate arithmetic, leaning down to tie his shoe, 
turning in his chair. 

PI ^[peer initiation): Peer talks to, pokes or in some way 

trys for attention of S^. 

lP*(Initiacion to peer): talks to, or in some ways trys 

for attention of peer* 

JJO (movement around rooj): Coded whenever subject is moving 

around xoo\u (other than times when entire group is moving, 
as in transition periods); observer need net try to decide 
whether each movement is appropriate or inappropriate; 
that question is better decided by comparing rate of move- 
ment across subjects. 
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IW ^[In appropriate task): Work on task not assigned or 

specified by teacher for that time* 

NO (appropriate group behavior or normative behavior) : Coded 

whenever the subject's behavior is task-directed activity 
which is appropriate for that time and situation* Included 
would be listening to the teacher explain a lesson, paint- 
ing during an art class, singing with others during music, 
lining up with the rest of the class to go out for recess, 
etc. The observer should take care not to include any 
behavior which might be more appropriately characterized 
as recitation. 

WK (work); A child may be engaged in appropriate group activity 
but not working e*g. s - observe a movie. Work means at desk 
on academic projects * Must work on teacher assigned task. 

Record when engaged in reading, writing, arithmetic, basic 
skills. 

RE (recites): Coded whenever subject recites, answers a teacher's 

questions, reads out loud, gives a speech, or performs 
before the class. 

VO (volunteers) : Coded whenever subject raistj *iis hand 

or in some other manner indicates a desire to recite 
or do whatever else the teacher may have asked for, e.g., 
someone to pick up papers; may be either In a class 
discussion or in a small group. 

TI (teacher initiation): Coded when the teacher "calls on" 

the subject or comes to his desk or activitiy area to 
speak to him; this interaction must be initiated by the 
teacher and not be a response to an initiation by the subject. 

IT (initiation to teacher): Coded when the subject indicates 

that he v?ants some attention from the teacher; he may 
raise his hand, speck or go to her; this behavior is differ- 
entiated from "volunteer" in that the subject's initiation 
to the teacher is not in conjunction with class discussion, 
group study, or reciting. 

RECESS BEHAVIORS ONLY : 

PL (play with others): Coded when the subject is clearly in 

the company of others, whether talking, playing a game 
or just walking around. 

AL (alone, isolated from others): Coded when the subject is 

engaged in solitary activity, whether playing a game or not. 



o 
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*The9e three categories were added or expanded by the 
(Walker and Buckley) for use at ELP. 



present authors 
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PE S PONSES ? 



0 (no response): Coded when no response from teacher, peers, 

or observer follows a behavior. There may be no response 
because the behavior does not demand one or because the 
subject Is clearly being Ignored, the observer should note 
this at the side rather than attempt to code the response 
any differently). 

A (attention) : Coded whenever the agent listens to or looks at 

the behaving subject; this Is a neutral kind of response 
with no obvious approval or disapproval in the attending 
response. 

P (praise): Coded when the subject receives praise or approval 

from an agent; may be verbal behavior or consist of 
gestures, e.g., smiles, head nods, applause. 

C (cotnplic.ice) : Coded when subject compiles with a command from 

another. 

I!C (non-compliance): Coded when subject does not comply with a 

command from another. Neither C or NC will probably be used 
very often; if they are, they will probably be responses of 
the subject to TI. 

PH + or - (physical contact positive or negative): Positive 

physical contact would include such behaviors as hugs, pats 
on the back; negative physical contact v?ould include 
aggressive behaviors from an agont such as hitting, spank- 
ing, etc. 

D (disapproval) : Coded when a subject behavior is followed 

by verbel or gestural disapproval from an agent; examples 
might be frowning, negative head nods, '’you shouldn't 
have done that,” etc. 



AGENTS: 

Each response should be subscripted with one of the following: 

T (teacher), P (peer), ~ (observer) 

to indicate tha agent of the response. 0 should rarely have to 
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be used. 



NAME 



DATE 



OBSERVER 



SHEET NO. 



TIME 



BASELINE 



ELP 



FOLLOW-UP 



CT .ASS BOOM BEHAVIORS: 



RESPONSES: 



NY Noisy 

Aggressive 
NA Mot attending 
PI Peer initiation 
IP Initiation to peer 
MO Movement around room 
IW Inappropriate task 
NO Appropriate group behavior 
WK Individual work 



RE Recites 
VO Volunteers 
TI Teacher initiation 
IT Initiation to teacher 

RE CESS ONLY : 

PL Play with others 
AL Alone, isolated from 
others 



1 . 

2 . 

3 . 

4 . 

5 . 

6 . 

7 . 

8 . 



NY AG NA *1 IP MO IW 



NO WK 



RE VO 



TI IT 



0 No response 
A Attention 
P Praise 
C Compliance 
D Disapproval 
HC Non compliance 
PH Physical (+ or 

AGENTS : 

T Teacher 
P Peer 
0 Observer 

FL AL 



Classroom: 
Grotp /C? 
individual . 7 
Transition 

Recess (Z/ 
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Individual <L/ 
Transition /“ 7 
Recess f 7 
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